OPTION 2 - Using pandas vs Spark vs. Koalas for Data Science

Pandas is a very well known Python library for doing Data Science. However, working with pandas limits you in your processing power. By using Spark, you can distribute the load and you'll be able to see a performance increase versus pandas, especially on large datasets. In this session, we'll share the differences and similarties and similarly deep-dive on Koalas; a meet-in-the middle solution. A must-join session for any BI-er, data engineer or data scientist