About two decades ago I thought I had a handle on big data. I was doing some data warehousing work with a telephone utility that had about 100 million transactions. That was a lot of data, I said to myself. Then, about 10 years ago, I was doing a review of a firm that audited financial trading on one of the major stock markets and I asked its big data guy how many transactions the company processed. His initial answer was, “On a slow day we get about 2.5 billion transactions.” “How many do you have on a busy day?” I asked with an air of shock. “4 or 5 billion,” he responded. Now that Read more
Posts Tagged 'big data'
Two of Cutter’s Agile experts are teaching public workshops in the Denver area March 31 – April 3. Don’t miss your chance to work with Hubert Smits and Lynn Winterboer, both of whom are highly knowledgeable, engaging, and successful trainers. So successful, in fact, that 98% of Hubert’s courses enjoy a 98% pass rate on the CSM test! If you’re in the Denver area, this is the perfect time for you to earn the key certifications to qualify you to act as Scrum Master and/or Scrum Product Owner on Scrum teams. And if you’re not in the area, what better excuse to head to the beautiful state of Colorado? Get the details and register here. Read more
Here are my predictions for 2014: 2014 will bring exponential expansion and evolution of the Internet of Things (IoT). This will also bring new opportunities for information security trailblazers unlike any we’ve seen before. The potential benefits of the IoT will be huge, but just as large will be the new and constantly evolving information security and privacy risks. We will see some significant privacy breaches resulting from the use of IoT devices as a result. New IoT risks, and resulting security incidents and privacy breaches, will bring a significant need for technology information security pros to also understand privacy concepts so they can implement privacy protections within all these new devices, and into the Read more
In case you couldn’t make it to this year’s Cutter Summit, here are a few of the nuggets from yesterday. And if you are here in Cambridge, MA, feel free to add some of your own in the comments!
The amount of data available to organizations to analyze and use in decision making is exploding. “Big Data” is all the rage and organizations of every size from every industry are struggling to make valuable use of the information available from their operational systems, business partners, and social networks. Organizations, seeking to respond quickly in an ever-changing marketplace, are hungry for current and useful information about their ecosystems. Data Warehousing and Business Intelligence (DW/BI) teams are working as fast and hard as they can to meet this ever-increasing demand with limited resources and time. Fortunately, DW/BI teams who embrace an “agile” approach are finding they can meet the top priority needs in short time frames Read more
How appropriate it is that Lynn Winterboer is joining Cutter just about at the time that we publish the Cutter Benchmark Review on Achieving an Agile Organizational Mind. With Lynn on board, we have another heavy hitter who applies the values, methods and practices of ‘traditional’ Agile to data, data warehousing, and business intelligence. The importance of so doing in the era of big data can’t be overstated. Just about every Cutter client I meet is struggling to extract meaning from the data he/she possesses. Needless to say, extracting meaning in an Agile manner constitutes an important competitive capability. Between the ‘old hands’ in the practice and the recent additions of Professor Giancarlo Succi, Sue Read more
With the widespread adoption of social media sites such as Facebook/Linkedin/Twitter and the increasing interest in multimedia sites such as YouTube and Instagram, social media has become one of the larger sources of Big Data. This increased volume of data has created a slew of new IT issues to consider — the most significant one being “What do we do with all this data?” As a result, we’re seeing an increased demand for more storage capacity, enhanced needs for compute power and the introduction of new technologies (such as Hadoop), making the investment to undertake a social media monitoring campaign no small task. With any substantial investment in new technology comes the question of value. Read more