Query tuning, data base development, data pipeline development

Starting at

$

30

/hr

About this service

Summary

Strong experience in SQL Server query performance tuning, query plan analysis, profiler etc.
Immense experience in writing T SQL scripts with joins, datasets, and correlated sub queries to implement complex business logic following best practices/coding standards.
Extensive experience in developing optimized stored procedures, tables, temp tables, table variables, CTE, sequence, views, functions, triggers, Indices, data constraints and dynamic SQL
Developed graph objects and implemented graph processing with query language extensions.
Extracting data from multiple sources like flat files, excel and various RDBMs through connection manager and linked service for transforming, cleansing, validating the data to load into destination and deriving business insight from applying analytics on the data.
Developed Synapse Analytics notebook in PySpark (Python) language and pipeline to extract data from CSV, JSON, PARQUET files from landing zone hosted on ADLS to load required format as per the business rules to segregate data into PARQUET files in bronze layer to expose data in the form of external tables and to use in Enterprise Data Model in silver layer to extract required information or statistics for Power BI report. 
Handled ETL solution design and implementing data processing using Azure Data Factory, email alert through Azure Logic App, created linked services and mapped secrets from Azure Key Vault to connect to database/ADLS.
Ample experience in Microsoft Visual C# in the script component of SSIS, custom logging, metadata tracking on the job, file and table level and event handlers for error handling. 
Vast experience in using parameters, variables, configurations to change package properties dynamically.
Worked on dimensional data modeling, creating data sources, data source views, building cube in SSAS and creating Tableau, SSRS, power view, Power BI reports, data modeling in power pivot.
Experience in tools such as Azure portal, Import and Export Wizard, SSIS Package Designer.
Worked on catalog and file deployment for SSIS packages, project creation, setting up integration service catalog and scheduling jobs in Azure Data Factory, SQL Server Agent and CAWA tool and troubleshooting. 
Implemented RESTful API in C# with MVC architecture, automated unit testing using NUnit framework and hosted on Azure App Services. Knowledgeable on dependency injection and mocking framework.
Hands on experience on implementing machine learning models such as classification, regression, clustering, decision tree, K-means clustering.
Worked on statistical methods namely predictive analysis, hypothesis testing and confidence intervals, principal component analysis and dimensionality reduction, market basket analysis, text analytics.
Good in identifying the areas of improvement for application stability and generating additional work.
Extensively involved in backlog grooming, planning, sprint demo, training, hosting touch base call with team to facilitate on the required for the on-time project delivery.
Experience in both SDLC life cycle and Agile methodology in requirement gathering, analysis, solution architecture, estimation, designing, documentation, development, unit testing, code review, deployment, and maintenance

What's included

  • SQL Optimisation

    Tuned SQL Queries

  • Database Design and Development

    SQL Queries and design documentation.

  • Data pipeline

    MSBI and Azure Data Pipeline Solutions.


Skills and tools

Data Engineer

Azure

Azure Files

Azure Functions

Microsoft SQL Server

Industries

Information Technology