I will show the Blockchain analysis in Jupyter interactive notebook using the external Spark cluster running in Kubernetes, everything dockerized.
The talk will briefly describe how Blockchain transactions work, but most of the time would be the demo. In the demo I will show how we can run various queries on the publicly available Blockchain data, graph algorithms such as PageRank for identifying significant BTC addresses and more.
Intended audience: intermediate, analysts, Bitcoin/Altcoin enthusiasts
Let's go together through the cloud native landscape and explore all the goodies that may help you to develop scalable and reliable distributed systems. Hopefully, you will leave this talk with basic understanding of Kubernetes and motivated to use it in production.
In this presentation I showed a simple way of leveraging Spark's GraphX and GraphFrames for analyzing the transaction graph of Bitcoin transactions. Real data was used.
I will show how you can leverage the containers and run the Spark cluster in PaaS, namely OpenShift and Kubernetes. For demonstration purposes, I'll be demoing the Blockchain analysis in Jupyter notebook using the Spark cluster running in OpenShift, everything dockerized. I am out of buzzwords.