Badges
Certifications
shahrukhkhan489 has not earned any certificates yet.
Work Experience
Senior Solutions Consultant
Cloudera• March 2017 - Present
Role Involves Engineering Solutions as well as revolves around Sales, Support, & Engineering Product Building Scalable Data Pipelines and Large scale Operational and Realtime Database solutions ● Data Warehousing ● ETL Offload ● CDC ( Change Data Capture ) ● Near RealTime Data Operations Operations over Large Scale Hadoop Clusters ● Setup / Troubleshooting ● High Availability ● Performance Tuning ● Configuration Management ● Capacity Management ● Security Management ● Cluster Migration ● Disaster Recovery Complete Automation of Large Scale Setup ● Linux OS Prerequisites ● Enabling Wire Encryption ● Hadoop / NiFi Cluster Setup ● LDAP/ Kerberos Setup Contribution: ● NiFi – Enabling HDFS NiFi processors to perform username Authorization ● Dr Elephant – Enabling Dr Elephant to work with YARN in HTTPS mode - #475 ● Superset – LDAP Authentication against Superset(Incubation) - BUG-97866 Technology Stack : ● CI/CD – GitHub, Ansible, Python, Shell Scripting, Java, REST API ● Scripting / Coding - Java , Python, Shell Scripting ● Platform – Ambari, HDP 2 / HDP 3, HDF, NiFi, HDFS, S3, YARN, Hive, HBase, Oozie, Zeppelin, Spark, Ranger, Atlas, Ranger KMS, Ambari Metrics. Knox, Sqoop, Kafka, Atlas, Hue, Superset, Postgres, MySQL, MIT KDC, FreeIPA, Active Directory, Salesforce ● Performance – Namenode Analytics, Dr. Elephant ● Tuning – Dr. Elephant, SmartSense Activity Analyzer ● Collaboration – JIRA, Service-Now
Engineer
Datametica• June 2015 - February 2017
●Designing, Building, Deploying, and Managing Continuous Integration and Delivery Pipelines for ○ Build, Release and Deployment of Multiple Projects ○ Data Orchestration over Linux and HDFS File System ○ DDL / DML execution across platforms such as Linux, Hadoop, Hive and Hbase ●Operations over Hadoop Clusters ○ Installation ○ Configuration Management ○ Security Management ○ Troubleshooting ●Configuration and Management Automation of Various Services/Applications over Infrastructures listed below ○ Hadoop ○ OpenStack ○ ILO Servers ○ Amazon Web Services Stack ●Automation scripts for day to day activities such as ○ Data Recovery ○ Data Backup ○ Monitoring ○ Alerts Technology Stack: ● CI/CD – Chef, Jenkins, GitHub, Gerrit, Gradle, Maven, Nexus, Ansible, Azkaban, Tonomi, Python, Shell Scripting, Java, RESTful web APIs, Google API, OAuth 2.0, Mail Utility ● Scripting – Shell Scripting, Python ● Platform – HDP, CDH, Ambari, Hadoop, HDFS, Amazon S3, DistCP , Map-reduce/YARN, Hive, HBase, MySQL, HUE, Apache Spark, Apache Ranger, Apache Flume, Active Directory AD/LDAP, Druid, NagiOS, Openstack, AWS, Docker, ECS, ECR, EC2, S3, EBS, VPC, Auto-scaling, Load Balancing, Cloud Formation, Tomcat, Httpd, Nginx, MySQL, PostgreSQL ● Collaboration – Bugzilla, JIRA, Service-Now
Research Assistant
Sardar Patel Institute of Technology• July 2013 - May 2015
● Pursuing Masters in Computer Engineering in the Field of Computer Vision / Image Processing ● Development of Augmented Reality App on Android using Java and OpenCV Library o Multithreaded Networked Framework Using Java Socket Programming o IEEE Publication on Distributed Model for Realtime Augmented Reality ● Practicing Linux System Administration and Cybersecurity Tools and Trends such as Honeypot Server ● Academic and Practical training students in Laboratories listed below o Linux / Open Source o Network Programming o Image Processing o Cyber Security Technology Stack : ● Programming - Java, C++, PHP, Android, OpenGL, OpenCV, Socket Programming, Wordpress, Bootstrap ● System - Fedora, Ubuntu, Apache Web Server, Httpd, OpenDNS, Wireshark, VsFtpd, Samba, Squid, OpenVPN, NIS, NFS, DHCP, WiFi-AP ● Security - Kali Linux, Metasploit, Meterpreter, AirCrack-NG, NMAP, Ettercap, Honey Pot Server
Education
Sardar Patel Institute of Technology
Computer Science & Engineering, ME• November 2013 - May 2015
Publication : Distributed Processing for Realtime Augmented Reality Participating Debugging Competition Teaching / Research Assistant IEEE Publication on Augmented Reality Wordpress Plugin Development Image Processing Algorithms Threaded Network programming Cyber Security Tools and Practices
Guru Ghasidas University
Computer Science & Engineering, B.Tech• October 2009 - June 2013
Programmed Various Modules of Wordpress Deployed Ecommerce Website Served as Project Leader Exploring Cyber Security Tools on Kali Linux Actively participated in college workshops & seminars Efficiently built a Program as Drop Box as a Contractor for directly submitting posts on word press blogs using meta web blog API