Big Data preparation

Few years ago i got a requirement to organize a messy data set for client's analytic purpose. they wanted to combine few fields and change some unstructured data for a format in that data set. it was a huge data set and doing manual changes was impossible. i was on the run to find a best solution for this problem and i found something call Data Preparation Application. Data Preparation Application that eases the burden of sourcing, shaping, cleansing, and sharing diverse and messy data sets to accelerate data’s usefulness for data visualization, analytics and machine learning applications.
This sound good for my problem. There are so many applications like Trifacta, Datawatch, Alteryx, Lavastorm that can be used to prepare big data set but was really interested about one application call Talend Data Preparation application.

Talend offers three data preparation tools: an open-source desktop version, Talend Data Preparation; and commercial versions Talend Data Preparation Cloud (offered as part of the Talend Cloud platform) and Talend Data Preparation (offered as part of the on-premises offering Talend Data Fabric),” according to Gartner. “These data preparation tools utilize ML algorithms for standardization, cleansing, pattern recognition and reconciliation, and also for offering automated recommendations to guide users through the data preparation process.

Commercial version is not my thing so i went with Talend Data Preparation application.You can find the installation guild from here.https://help.talend.com/reader/install

After starting you can start to play with your Unstructured data. Taland Data Preparation ensure the information is complete in all fields; eliminate duplicate entries; transform and standardize the data.
First, when you enter the tool, it prompts you with a pop-up guide to import your Excel file or other types of data sources.

Unstructured Data in spread Sheet.

 

Then you select that same spreadsheet and in just a few clicks you can cleanse, standardize, complete fields and filter the data by region, job title, etc

 Efficient, accurate business decisions can only be made with clean data. Using Taland Data Preparation you can create very cleansed and well structured data very quickly and easily.