DATA CLEANING WITH SQP (pt2)

Checking for Duplicates

It is very important we check for duplicates in our Data as part of Confirming the integrity of our data.
There are some data fields that are not meant to have duplicates, for example, the UNIQUE ID column in the video below.





We need to confirm that there are no duplicate values in the UNIQUE ID Column.

We can do that using the query below:

Select UniqueID, COUNT (UniqueID)

FROM PROJ.dbo.Nash

GROUP BY UniqueID

HAVING COUNT (UniqueID) >1

At the end of the Query, we can see that no duplicate Values exist in the UNIQUE ID Feild


Comments

Post a Comment

Popular posts from this blog

EXPLORATORY ANALYSIS OF COVID_19 CASES AND VACCINATION IN NIGERIA

Image
 Introduction: This is a project on the Covid_19 cases and Vaccination as at April 24th, 2022 among the 36 States in Nigeria including the FCT.  Data was pulled out from the NCDC website for the project. Data was clean enough except for some columns which were cleaned out that didn't serve the purpose such as clinics, testing centers, etc.  All reports from labs across the states are sent to NCDC for computation and publishing Columns and rows with null values were cleaned while there were no duplicate values in the cell. The columns were formatted from text to numbers so python will be able to read the columns with figures as strings instead of objects. Computation cannot be carried out on columns with object data type Analysis and visualization were carried out using python libraries such as pandas, matplotlib, Plotly, and seaborn. Python was chosen for the analysis due to the structure of the data, which has a large number of columns, computations and analysi...
Read more
  BUILDING AN EXCEL DASHBOARD      DESCRIPTION This is a Descriptive Analysis of the Data on the World's population from 2010 to 2020.   The main information provided are Various Metrics (Series by which data is classified), Country, and Region. More on the Series is available below The Dashboard visualizes the data of the World Population by metrics such as: 1. Infant Mortality for both sexes per (1000 Live births). 2. Life Expectancy for both sexes(years) 3. Life Expectancy at birth female (years) 4. Life Expectancy at birth for males (years) 5. Maternal Mortality ratio (deaths per 100,000 population) 6. Population annual rate of increase(percent) 7. Total fertility rate (children per woman ) It also displays a time series from 2010 to 2022 at a five-year interval. The various charts on the dashboard were created to interact with each other by the use of the slicers DATA  The data was sourced from data.un.org.  Columns with information not usefu...
Read more
 TABLEAU FUNDAMENTALS....DATACAMP Learning a BI tool is of great importance for anybody pursuing a career in Data Analysis, Business Intelligence, and Business Analysis. While there are countless BI tools, one might be stuck in between learning as many as possible. It is important, however, to know the basic of the widely used BI tool such as Tableau, Power bi, IBM Cognos, Qlik, Alteryx, etc. I believe however that it would be beneficial for one to master one of the above-mentioned. I started out using Power Bi, Alteryx, and Tableau but decided to stick to Tableau. The reason is that I found Tableau the most challenging and I feel if I can master it, the rest would be a bit easy to master.  Thanks to Datacamp and Youtube I took courses and tutorials to sharpen my knowledge and bridge the GAP between what I already and how to use up do date Tableau Built-in Functions. From courses such as  1. Introduction to Tableau 2. Analyzing Data in Tableau 3. Creating Dashboards in Ta...
Read more