big data engineer |pyspark |etl |docker k8 and boto3| shell scripting | sql | dremio | hdfs@ Allstate India
Bengaluru, Karnataka, India
Omprakash Arumugam
GET FULL PROFILE 
Real-Time AI Research
FlashIntel GPT
Tell me more about Omprakash Arumugam?
FlashIntel GPTOmprakash Arumugam is an experienced Big Data engineer with 8.5 years of work experience. He is skilled in SQL, shell scripting, ABAP, Python, and Unix. Currently, he is working as a Big Data Engineer using PySpark, HDFS, Dremio, and Boto3 to create and manage data lake. He has also worked as an ETL developer and has experience in unit testing, unit testing, and billing. Omprakash has worked as a functional tester and has experience in billing and billing. He is proficient in various technologies and tools such as PySpark, HDFS, Kafka, Dremio, Scality S3 bucket, Abinitio,
For inquiries about Phone Number and Email, please click here Unlock Contact
Emails and Phone Numbers
About
Currently working as an Big data engineer using PySpark, HDFS, Dremio, using Boto3 to access S3 bucket for creating and managing the data lake which enables the data scientist to create and data run models on data lake. Involved in migration of spark on yarn to spark on docker and kubernetes. Worked ETL developer using the tool Ab initio, playing the role of Generalist like development of new jobs, performing unit testing, writing python or shell script to reduce the manual work, deployment of code to QA and supporting the testing activity and monitoring the production jobs and fixing them. I have also worked as functional tester in communication field and also have good knowledge in billing related testing. I have automated many script using shell scripting which involved Unix related task. Technology and tools : PySpark, HDFS, Kafka, Dremio, Scality S3 bucket Abinitio, Python,shell scripting, SQL, Jira, Version One, Confluence, GitHub
...See MoreWork Experience
big data engineer |pyspark |etl |docker k8 and boto3| shell scripting | sql | dremio | hdfs
Lead Big Data Engineer
Big Data Engineer
Senior API Developer
IT Services and IT Consulting
Omprakash Arumugam's Professional Milestones
- Founder (2018-02-01~2019-10-01): Building a successful firm from the ground up, revolutionizing the industry with innovative products and services.
- Associate Software Engineer (2015-06-01~2018-02-01): Developed and launched a highly successful software product, showcasing technical expertise and technical expertise.
Skill
Sql
Shell Scripting
Ab Initio
Python
Unix
Algorithm Design
Certification
Colleagues
Sunilkumar Majhi
product owner business analyst duck creek p&c domain
Priya Tikhe
author and proven executive: strategic human resources - people talent operations performance management and patent owner with m&a integration entrepreneurship experience
Rashmi Dongre
product owner | safe 5 1 popm | product management | lead rpa business analyst | intelligent automation
Sunilkumar Majhi
product owner business analyst duck creek p&c domain
Vamsi Mallireddy
Product Owner | Product Manager | MBA Product Management
Other Named Omprakash Arumugam
Frequently asked questions
We found 3 Omprakash Arumugam's email addresses
We found 1 Omprakash Arumugam's phone numbers
Omprakash Arumugam's social media include: Linkedin,
Omprakash Arumugam works for Allstate India
Omprakash Arumugam's role in Allstate India is big data engineer |pyspark |etl |docker k8 and boto3| shell scripting | sql | dremio | hdfs
Omprakash Arumugam works in the industry of IT Services and IT Consulting
Omprakash Arumugam's colleagues are Sunilkumar Majhi,Priya Tikhe,Rashmi Dongre
Omprakash Arumugam's latest job experience is big data engineer |pyspark |etl |docker k8 and boto3| shell scripting | sql | dremio | hdfs at Allstate India
