IKO
  • Blog
  • IKO 2019
    • Programme 2019
    • Organisers 2019
    • Register 2019
    • Venue 2019
  • IKO 2017
    • Organisers 2017
    • Programme 2017
    • Resources 2017
  • IKO 2016
    • Organisers 2016
    • Programme 2016
    • Resources 2016
  • IKO 2015
    • Organisers 2015
    • Programme 2015
    • Resources 2015
  • Contact

Big Data's Dirty Little Secret... People

8/16/2016

2 Comments

 
A couple of articles from zdnet.com: 

Big data's biggest problem: It's too hard to get the data in: "According to a study by data integration specialist Xplenty, a third of business intelligence professionals spend 50% to 90% of their time cleaning up raw data and preparing to input it into the company's data platforms. ... The data cleansing problem also means that some of the most widely sought after professionals in the tech field right now are spending a big chunk of their time doing the mind-numbing work of sorting through and organizing data sets before they ever get analysed."
The dirtiest little secret about big data: Jobs: "As a result, many companies have tried to put machine learning and artificial intelligence to use in doing some of the data sorting and data cleansing... Still, a lot of these companies quickly run up against the limitations of AI. It's excellent for very narrow, specific purposes. But, it's not very good at making judgment calls or deciding on something that falls into a gray area... Because of that, many companies have discovered that humans do the work of data sorting much better than algorithms, and so they are putting people to work behind the scenes to help their big data projects succeed."
By Maish Nichani
2 Comments
Our Website link
5/13/2022 04:59:20 am

This is so true - cleaning up data is a massive struggle. A bad character here, wrong data there - just little mistakes can have a massive impact on reporting, functionality and more. It's stressful to take the time to clean up data because it really takes someone who understands what's going on in the system, as well as someone who cares enough about quality assurance to do a trustworthy and effective job.

Reply
liana link
9/15/2022 01:39:28 pm

thanks for info

Reply



Leave a Reply.

    News

    We are using this blog to keep you updated on conference planning and organisation, and to link you to informative discussion materials.

    Archives

    August 2017
    May 2017
    March 2017
    January 2017
    November 2016
    September 2016
    August 2016
    July 2016
    May 2016
    March 2016
    February 2016
    January 2016
    December 2015
    October 2015
    September 2015
    August 2015
    July 2015
    June 2015
    May 2015
    April 2015
    March 2015
    February 2015
    January 2015

    Categories

    All

    RSS Feed

Copyright © 2019 Conference Organisers. All rights reserved.