Monday, November 23, 2020

Data Lake e Data Warehouse.

 Data Lake is defined as the storage or repository of a large volume of data, it can be structured or semi-structured or unstructured.

It is the large central "body", which feeds the various functions that require data.

A good view of a data lake that I found is the one below:


 Interesting how Data Science, even though it is an exact science, it still requires a good capacity for abstraction, right? 😄


Okay, we have our definition of  Data Lake, so ... What is Data Warehouse? Isn't it the same thing?


No...


Data Warehouse, is where we will store structured data that has already been processed for a particular function. While at the Data Lake, we have all kinds of data (raw or not) available for use.

Look at this image, how cool!:



Visualizing things makes it easier to understand, right? By the way, later we will talk about Data Visualization, something very interesting!


That's it for today!


Thanks for the visit!

Creating a Connector between AWS and Microsoft SQL Server in Python

One of the challenges I came across recently was to create a connector that would collect specific columns in a csv at AWS and load to a tab...