Surgiu uma necessidade de baixar os dados disponibilizados no site da B3 através do download de arquivos referente ao tópico “Banco de Dados Completo”, através do link Código ISIN | B3, conforme imagem abaixo.
Esse link ele extrai os dados de um arquivos com a extensão .zip, e dentro desse arquivo zipado possui três arquivos: EMISSOR.TXT, NUMERACA.TXT e Leiame.pdf.
Portanto ao invés do usuário entrar no site diariamente (ou no período que ele preferir) e baixar esses dados, criei um script em Python com estruturas de de RPA utilizando principalmente a biblioteca selenium.
A biblioteca selenium ela literalmente abre o…
In this article I will show how the data visualization is different using the “Usage” type as “Parent” to create hierarchies of a table automatically, through a multidimensional cube created by SQL Server Analysis Services (SSAS), through a multidimensional model.
The data was taken from the AdventureWorksDW2017 backup file made available by Microsoft itself through the download backup files.
With this DW restored in a SQL Server database, we can connect to SSAS and create the desire dimension, in this case we use the dimension table “DimEmployee”, and create a cube with the fact table “FactResellerSales” and “FactSalesQuota”, just for…
For those who want to have more control over the management of Power BI licenses to help with Data Governance, managing the allocation of Power BI licenses (Free and Pro) is a fundamental task for administrators. Therefore, through PowerShell scripts, we were able to obtain AzureAD data and know who the users are, which licenses are active in Azure, and who owns the licenses.
With that, we managed to get some insights:
In the BI processes, we have several jobs that are scheduled to be executed according to a time, or sequence, or any other option that is selected.
So it is necessary to be managed by the BI team which are the processes that are being executed, how long it is taking, which is the heaviest process, which system, which area (or data mart), etc. Anyway, all the possibilities that may happen and that we have at hand some tool to make a quick and right decision. …
We have identified an issue where Power BI has a constraint when using a date filter.
When I filter by “Relative date”, and put “is in the last” and mark as “Include today” and choose the value “1” as shown below, after 9pm (Brazilian time), it marks as the next day of today’s date and not the today’s date (as it should be).
This is because the Power BI desktop or Power BI service uses UTC time as the default, and it is not possible to change it manually or leave any other predefined time. Therefore, since I am located…
For those who work with BI (Business Intelligence) and with Oracle environment and would like to know most of the objects that are inside your Data Stage and Data Warehouse.
Although we used this modeling for the BI team, this analysis can also be useful for DBA’s or any other team that manages a database.
Obviously, this process can be improved and even add more details, as for example, we can see more easily what the dependencies between objects are (Package and Procedure, Procedure and Procedure, Procedure and Table, etc.). …
In this post, I will show you how to get a file’s metadata inside the Windows system using a PowerShell script.
A file’s metadata can have the name, size, creation date, file format, directory the file is located, etc.
This information can be important if you are working with photos for example, where you can store the photos in a database with your information.
So first, we must download the powershell script that has the function to access this information from a file through the link below.
After downloading the PS1 file (powershell script), we can use the script to…
In a BI environment, we find a lot of data that is not stored in a database, and also a lot of users who have ease and preference in storing data in an Excel spreadsheet. So in this post I will show you how to convert an Excel file using a PowerShell script.
In fact this is a very easy process, we can convert all tabs within Excel, or convert only a single tab. So that way, converting to a CSV file, it can be easily added to a database through a procedure or ETL tool, instead of a native…
This post describes how to get SharePoint items from any lists by using PowerShell.
In some BI architectures, where the user wants to store the data in spreadsheets or somewhere that is not stored within a database, we can usually offer the option of storing that data within a list in SharePoint.
In this way, we can create lists and store data, creating a more complete organization, security, access via MS Office 365, history of data changes, etc.
Again, I’m not a PowerShell expert, but after looking at forums, official documentation and even talking to Microsoft support, I managed to…
We had some cases where we would like to check what information was within the Power BI service and be able to make a decision in the BI area, based on this data.
Therefore, one way we found to access this data and be able to work it in a database or even within an Excel spreadsheet, was extracting the data through a script in PowerShell and exporting it in a CSV file.
I’m not a PowerShell expert, but after looking at forums, official documentation and even talking to Microsoft support, I managed to solve the problem we had with…
Mechanical Engineer and developer in the Business Intelligence area, passionate about technology, I have knowledge and experience to create a BI architecture.