Badges
Certifications
ed_eder has not earned any certificates yet.
Work Experience
Senior Software Engineer
Thoughtworks• July 2021 - Present
I work as Data Engineer
Senior Software Engineer
Indra• September 2020 - July 2021
I worked as a Senior Data Engineer,. I work with development team to build a Hadoop Datalake to Telefonica, migrating Teradata databases to HortonWorks HDP using Apache Technologies Sqoop. We are migrating csv flat files to HDFS. We use PySpark to data transformation and other Spark libs as Apache Kafka. We use Scrum as development methodologies.
Software Engineer
Dataprev• December 2014 - September 2020
For two years and a half, I worked as a Frontend Developer and I used HTML5, CSS3, LESS, SASS, JQUERY, BOOTSTRAP, JSF, PRIMEFACES, BOWER, NPM, MAVEN, NEXUS, GULP, VSCODE, GIT and Linux Environment to migrate/upgrade legacy and old interfaces to modern visual and rich interfaces for many web applications. From September 2017 until September 2020, I worked as a Big Data Developer and use Hadoop, HDFS, Hive, Pig, Oozie, Sqoop, Cloudera Data Platform, Apache Spark, Apache Zeppelin, D3JS, Oracle, Git, Python, IBM Urbancode, MLFlow, etc. I work with development team to build a Hadoop Datalake to company, migrating Oracle databases to Hadoop Datalake using Apache Technologies Sqoop, Oozie and NiFi. We are migrating csv flat files to HDFS. We use PySpark to data transformation and I am studying other Spark libs and Apache Kafka. I give internal training about Data Ingestion and Datalake Principles, helping teams a write Oozie workflows, Hive and PySpark scripts.
Education
Universidade Federal do Rio Grande do Norte
Software Engineering, B.Tech• August 2013 - August 2015
IFRN
Information Technology, B.Tech• August 2004 - August 2008