Working with Big Data

Big Data is a collection of large database that cannot be analyzed with normal statistical ways. The datasets are measured in exabytes. The data can be any kind of information such as numbers, videos, pictures, maps, words and phrases. There are two types of big data. Structured data: numbers and words that can be easily grouped and analyzed such as account balances and transaction data. Unstructured data: more complex information such as reviews, photo and comments on social networking sites. To analyze unstructured data, keywords should be considered to allow users to filter based on searchable terms. Most workers who deal with data are called data scientists or data analysts. These workers use computer programs or algorithms to detect patterns or find usable information. Before that, they design ways to collect and aggregate the data. Then, they set methods of storing and organizing the data. Workers do a task called scrubbing, which is process, and clean the data from errors. So, these workers determine which data should be save and analyzed. After that, workers create graphs, charts or tables to summarize the results that they got to present it to managers and clients. Data analysts’ job tasks differ, based on the field because different fields have their different kind of data. In business, workers focus at purchase data and customer reviews to know what customers’’ needs. In e-commerce, data analysts help companies by getting customer reviews, comments and suggestions to improve customer service. In finance, analysts study account data, credit and debit and transaction data to look for fraud and other security breaches. Governments collect a lot of data too. They need analysts to secure data from sharing. In healthcare, analysts use data to estimate the cost effectiveness of new drugs. They also create software to track disease outbreaks. Many different fields in science such as chemistry and biology produce huge databases. Analysts help with the logistics and analysis data. Analysts who work in social network field gather data like comments, pictures and videos and sort them to help create targeted advertising and better customer services. Analysts collect data for telecommunications companies to help them adjust better services to their costumers. Being analyst is not easy. Students get training in many fields like mathematics, statistics and computer programming to help them solving problems and to interpret the results in a logical way. Also, they need other kinds of training such as communication skills, teamwork and curiosity as well.