SF Data Weekly - Lottery Picks, PrestoDB and Madagascar Floods

Can you win the lottery using data analytics? Using python, OCR, and data analysis to create a program to pick numbers for the Yotta Savings lottery.

Isn’t it weird the amount of boilerplate code necessary in order to execute 2 simple python scripts on Airflow? If your DAGs share similar values, it’s probably better to write a Factory class to build your DAG programmatically. This piece explains how.

For our Salesforce users with Mongo databases, Xplenty is having a live demo on April 8th, @11am PT. Learn how to combine multiple data types to get a single, unified view of customer data. [Sponsored Content]

Presto is a popular distributed SQL query engine for interactive data analytics. With its massively parallel processing (MPP) architecture, it’s capable of directly querying large datasets without the need of time-consuming and costly ETL processes. This article will help you run Presto faster on AWS EMR.

MySQL isn’t usually the first pick for big data, but sometimes you have to use the tools you have. If you’re in that position, this is the first in a series of articles that dives pretty deep into MySQL tuning.

This year’s February cold snap in Texas, analyzed and including a Jupyter notebook if you want to take it further.

A reusable way to trace functions in Python, something every analyst who’s using Python needs to hunt down those last few troublesome bugs.

Using USGS Earth Explorer and Sentinel hub images to visualize floods, with the 2020 Madagascar floods as an example. This has some really cool visualizations plus the code that created them.

Two data researchers who say they can’t draw explain how they use simple stick figures and other drawings to sketch out their data stories.

Dhevi is a backend software engineer who made the transition to data engineering at Netflix. She explains why she made the switch, and why Netflix.

Zocdoc is a medical appointment booking service that had a data warehouse which quadrupled in size (and cost) in less than two years. How they made a choice that reduced cost and increased performance.