Overcoming The Data's ETL Problem, which ends up as a Beautiful Dashboard

One of my clients ever asked me if I could do something to help them build a reliable Dashboard that could easily be understood and accessible for Stakeholders and other non-technical people, so they can take a peek at where this Data comes from and what it tells us about. Shows below.

The data processing part was the hardest thing to do, because of how scattered the data was and the sources of Raw Data couldn't be imported using the API. Therefore I needed to clean the data first, which I did using the spreadsheet function, and I also built the Automation for it using Apps Script, which is free and very accessible for someone that don't have a budget to handle Cloud Database or On-Premise Database and Premium ETL Services. The Apps Script code is shown below

function copy() {
  let sheetURL = "https://docs.google.com/spreadsheets/d/11W3dM4mM_DqBMNUqIHOqBdo1ABpVDmN45zqdzvX_fHk/edit#gid=667507400";
  let spreadsheetSource = SpreadsheetApp.openByUrl(sheetURL);
  let sheetToCopy = ["Dec", "Database POP Fresh", "Database Prod - Cust"];
  let getSheets = SpreadsheetApp.getActiveSpreadsheet();

 for(let i = 0; i < sheetToCopy.length; i++ ){
    let sheetSource = spreadsheetSource.getSheetByName(sheetToCopy[i]);
    let getData = sheetSource.getDataRange().getValues();
    let newSheet = getSheets.insertSheet();
    newSheet.getRange(1,1, getData.length, getData[0].length).setValues(getData)
  }
}

With this, I boosted the company's ETL Performance, and later on I made a Cloud Database using Amazon RDS for them, which became one of my legacies for the company, and this is what they said.

Yudha was a great help! We needed help with data cleaning, entry, and analyzing. He was always on top of every task given and he gave 110% into them. Yudha is definitely a great worker to hire for any data, programming task. He is respectful, hardworking, and always prompt. Thanks for all your help!

Like this project