SF Data Weekly - Visualizing Apartment Hunts and two ways to AB

Daniel takes the lemons of a 46 day unsuccessful Munich apartment hunt and turns it into the lemonade of some really interesting (and humorous) data analysis and visualization of the Munich rental market.

Javier looks data pipeline orchestration tools like Airflow, Ozzie, Dagster and Prefect, and picks the best use case for each tool.

PartiQL is a SQL-compatible query language that can be used to directly query JSON data. This article is a step-by-step walkthrough that demonstrates the use of PartiQL to query data in the Fast Healthcare Interoperability Resources (FHIR) JSON format directly from Redshift.

Cross-database queries are a new feature with Redshift R3 instances. This article includes examples detailing how to set up permissions and how to connect with tools.

Robert’s open source tool Whale is a simple metadata scraper that crawls your data warehouse and scrapes metadata for querying with a GUI, to allow you to find and understand data without time-consuming manual search.

Ideal data granularity is critical for accurate and actionable business intelligence. This piece explains ideal granularity and helps you avoid common granularity-based mistakes.

The pandas’ library is a vital member of the Data Science ecosystem. However, the fact that it is unable to analyze datasets larger than memory makes it a little tricky for big data. This piece give you two different alternatives to get around this pandas limitation.

A short introduction to data visualization milestones, from prehistoric to modern time.

A quick walk through of public data sets available for free use with Google BigQuery and DataStudio, including sample queries and visualizations of the Johns Hopkins’ COVID-19 dataset.

When you can’t do a proper AB test, try counterfactuals. Joshua from Best Buy Canada gives examples of market-based and time-series-based approaches to synthetic AB tests.

An overview of Kevin Liou and Sean Taylor’s research into variance-weighting A/B test estimates, where they were able to reduce variance by 17 percent, with only a slight increase in bias.

Those of you looking for a data science job might be interested in Vicky’s experience of being hired as a data scientist without any data science experience. Here are this week’s jobs:

Energy Data Analyst - Tesla

Data Scientist - Smule

AWS Data Engineer - Rivian