In Snowflake there are useful commands like SHOW USERS (shows the users in your environment) or SHOW GRANTS TO ROLE (shows the privileges given to a certain role). The results of these commands are shown like tables however, you cannot filter them like SHOW USERS WHERE … You can however use the commands TABLE and…
Want to append the data of several files into ONE table? You could do this using Power BI Dataflows. However, you can also do this in Snowflake using the COPY INTO command. Imagine you have an AWS S3 bucket with a folder containing a lot of files that need to be appended into a single…
Do you want to load data from AWS S3 bucket to Snowflake? Setting up access to an S3 bucket from Snowflake can be done in 5 simple steps. Want more details? Check out the link at the bottom for a detailed description of each step. Step 1: Create IAM policy in AWS that allows a…
Clustering depth indicates if micro-partitions are overlapping with one another. Ideally, micro-partitions are not overlapping and are contiguous. Being contiguous means that one micro-partition seamlessly connects with another micro-partition. Sometimes however, micro-partitions are overlapping. A reason for this could be a less than optimal clustering key. Whatever the reason, this is not ideal, because now…
Tables are stored within Snowflake as micro-partitions. Put simply, micro-partitions are basically horizontal slices of the table. These slices divide the table into subsets of rows. This process is called “clustering”. Clustering is done to avoid unnecessarily reading micro-partitions that are not needed for the query. This leads to more efficient, faster and cheaper results.…
Tasks are an excellent scheduling tool in Snowflake. You can use tasks for a lot of different purposes. Below are some examples: The scheduling can be done using CRON (for example, run a task every hour, minimum schedule is one minute) or using a trigger. You could trigger a task to run after another task…
A stream is a great way to track changes to a source table in #Snowflake. These tracked changes can then be used to create an incremental load for example. There are 3 types of streams: – Standard: tracks all data manipulation changes to an object. – Append-only: tracks only inserts. – Insert-only: tracks only inserts…
