SF Data Weekly - Lots of Redshift and a Sense of Wonder

Alli Torban, host of the Data Viz Today podcast, gives some real-world examples of data visualizations with physical objects, including her first one with a T-Rex and a bus.

Dataform is a new SQL environment, similar to dbt, and this short intro shows how to use it in a BigQuery data pipeline.

Rapid data preparation and transformation for ever-evolving and changing data requirements. Secure & compliant data pipelines. Get started today. [Sponsored Content]

How Redshift’s new automatic optimization function applies sort and distribution keys automatically using ML.

How to share data between Redshift clusters, a feature of the new RA3 cluster architecture that’s now in preview.

An introduction to Redshift’s new ‘SUPER’ data type, which allows you to store the semi-structured data in Redshift tables. Redshift also adds support for the PartiQL query language to seamlessly query and process the semi-structured data. Redshift now allows parsing of JSON data into SUPER, along with a 5X increase in insertion into SUPER columns versus scalar columns.

For those of you who are curious about Redshift, or haven’t been keeping up with what’s new, this is a good overview of the different ways that you can use Redshift as part of your analytical stack, and it includes a discussion of affordability and efficiency.

If you’re creating a database and want to test it, creating dummy data to do so can be time-consuming and tedious. This piece shows how to use SQURL to make dummy data generation quick and relatively painless.

Artemis is an open source tool built in Deno with a graphical interface for users to visualize the performance metrics of queries to external GraphQL APIs. This piece is a short demo of its capabilities.

Cufflinks helps to connect Plotly with the Pandas library. Here’s what you can do with that connection.

This post dives deep into how transparent huge pages (THP) slow down the system and explains why PingCAP disabled THP to improve database performance. It also explains why you should, too.

Uber built uWorc, or Universal Workflow Orchestrator, to allow completely code-free workflow orchestration. It includes a simple drag and drop interface that can manage the entire life cycle of a batch or streaming pipeline, without having to write a single line of code.