Wij zijn Business Intelligence- & data enthousiastelingen. Met vele jaren ervaring in elke schakel van de keten van Business Intelligence denken wij in oplossingen voor onze klanten.
In het blog vind je artikelen over Business Intelligence in het algemeen en verscheidene tools in het bijzonder. Voorbeelden van onderwerpen zijn Power BI, DAX, SQL, Data Warehousing, Data Modeling, etc.
Nieuwsgierig naar onze projecten? Enkele voorbeelden betreffen het ontsluiten van data middels een webscraper ontwikkeld in Python, het toepassen van business logica en de opslag van data in Azure SQL DB en rapportages in Power BI.
Ever wanted to feed the directory tree of your repository to AI? In order for AI to help you, you need to give it the right context. Sometimes, this means giving it the directory tree of your repo. You could use the standard “tree” command by installing it using “sudo apt install tree” in Linux.…
A Python script in an Azure Function is used to retrieve data from a REST API. Azure Data Factory is used for orchestration. The Python script is also used to transform and append the data. Transformations included parsing nested JSON files and applying business logic by e.g. adding descriptive columns. The result is several fact-…
AWS Project: VPC with a public subnet containing a NAT gateway. The NAT gateway can be used for outbound traffic to the internet from the EC2 instance in the private subnet. A route table connects the destination 0.0.0.0/0 to the internet gateway for the public subnet. In the public subnet, there is an EC2 instance…
Extracting data from an AWS RDS MySQL database, storing it locally as a CSV and uploading it to S3. This can be done doing a full load (“extract_mysql_full.py”) or an incremental refresh (“extract_mysql_incremental_binlog.py”) using binlog. In my case, binlog needed to be set up within AWS RDS MySQL by turning on automated backups, creating a…
AWS Networking Project: VPC with a public and a private subnet and an internet gateway. A route table connects the destination 0.0.0.0/0 to the internet gateway for the public subnet. In the public subnet, there is an EC2 instance that can be accessed via SSH through the correct security group settings.Using the EC2 instance in…
How do resources in different subnets within the same VPC communicate with each other? Route tables to the rescue. EC2 A in subnet A (CIDR 10.0.0.0/24) and EC2 B in subnet B (CIDR 10.0.1.0/24) are both in the same VPC. They can communicate with each other because the main route table contains a route with…
Classless Inter-Domain Routing is a way to allocate IP addresses within a network. Every machine that is connected to the internet has a unique number, called an IP address. With CIDR you can create a range of private IP addresses for a VPC. These IP addresses are allocated to resources that you deploy within your…
Some time ago I shared that I would try to broaden my knowledge in the networking department. True to my word, I finished my first networking project: deploying an EC2 instance (a sort of virtual machine) in a public subnet within an Amazon Virtual Private Cloud (VPC). A VPC is like a cloud network environment…
Data pijplijn ontwikkeld met behulp van data build tool (dbt), Snowflake, Dagster en Github. Er is een Medallion structuur geïmplementeerd met behulp van transformaties in dbt. Verder is dbt gebruikt om SCD2 te implementeren door middel van snapshots. dbt is ook gebruikt om generic en custom tests uit te voeren zoals het controleren van de…
Ever wondered how to do a Multi-Column-JOIN in Power Query M? It is so simple to join TABLE_A to TABLE_B in SQL using multiple conditions on multiple columns: But how do we replicate this in Power Query M? Turns out we can add a column using the Power Query M function Table.SelectRows. Take a look…