Querying Over Domain Data

Today we rolled out a new feature that allows Operators and Analysts in the Amperity platform to immediately query data ingested into Amperity as part of their data exploration and iteration workflow. The ability to immediately query ingested data will save Operators many hours of iteration to explore and transform data, which would otherwise be spent waiting for database generation to make data available for exploration. This feature also saves Analysts time by making source data more easily available to query. Overall, this new feature significantly shortens the data transformation cycle and simplifies the experience of exploring source data in Amperity.

Before this change, you could not directly explore domain data in Amperity without loading that data into a database. This meant you would have to run a full database build after the data landed in the platform, costing minutes or hours. Now you can directly explore the domain data without building a database.

This simplifies a number of common use cases, including:

Adding a new data source to Amperity and transforming it to use in a database
Making a change to a Custom Domain Table
Loading new data to replace an existing domain table with errors
Exploring newly ingested data for the first time to determine which semantic tags should apply
Identifying potential primary keys for a newly ingested dataset
Deciding how to handle missing rows, values, or improperly formatted data

To directly explore domain data, simply:

Create and update a Domain Table or Custom Domain Table (CDT)
Click
Publish to Queries
at the top of custom domain tables (runs in 1-3 minutes depending on the table)
Navigate to queries tab and run queries over ‘Domain tables’
Test updated query logic in queries then move the logic into the CDT or replace the domain table with new data
Repeat this process until complete

Note that tables will be updated as part of daily workflows automatically. We'll post updated documentation to our docs site soon.