Comments on: Why Big Data? Here’s Why I’m Interested http://marshallk.com/why-big-data-heres-why-im-interested Thu, 17 May 2012 07:27:00 +0000 hourly 1 http://wordpress.org/?v=3.2.1 By: Amy http://marshallk.com/why-big-data-heres-why-im-interested/comment-page-1#comment-145433 Amy Sun, 18 Apr 2010 18:13:43 +0000 http://marshallk.com/?p=800#comment-145433 I got interested in big data after watching the last TED video on Open Standards and data, I was so excited about it i even posted an article on my blog about it! After some research i found out that it's actually our right to demand data from companies out there (some which i won't mention and that have not opened up their data to anyone) What was particularly interesting to see is the connections that linked data offers us and that's what people and companies can tap into to provide rich & helpful experience to so many people out there. In the future I'm sure we can see data interopability between our favorite social networks, because at this stage that isn't totally possible yet. Excuse my lack of in the comment. This is something really exciting. BTW everyone just because you're small, doesn't mean you can't contribute - Try starting here: http://www.okfn.org/ I got interested in big data after watching the last TED video on Open Standards and data, I was so excited about it i even posted an article on my blog about it!

After some research i found out that it’s actually our right to demand data from companies out there (some which i won’t mention and that have not opened up their data to anyone)

What was particularly interesting to see is the connections that linked data offers us and that’s what people and companies can tap into to provide rich & helpful experience to so many people out there.

In the future I’m sure we can see data interopability between our favorite social networks, because at this stage that isn’t totally possible yet.

Excuse my lack of in the comment. This is something really exciting. BTW everyone just because you’re small, doesn’t mean you can’t contribute – Try starting here: http://www.okfn.org/

]]> By: Brett Sheppard http://marshallk.com/why-big-data-heres-why-im-interested/comment-page-1#comment-144492 Brett Sheppard Mon, 29 Mar 2010 03:27:13 +0000 http://marshallk.com/?p=800#comment-144492 Good article. Take a look at BigDataNews.com -- we're starting to get a good set of articles and community sharing, and should be announcing a 2nd corporate sponsor this week. If you'd be interested in posting articles I can set up an author account for you. Sincerely, Brett Brett Sheppard Editor, BigDataNews.com Good article. Take a look at BigDataNews.com — we’re starting to get a good set of articles and community sharing, and should be announcing a 2nd corporate sponsor this week. If you’d be interested in posting articles I can set up an author account for you.

Sincerely, Brett

Brett Sheppard
Editor, BigDataNews.com

]]> By: Joshua Guffey http://marshallk.com/why-big-data-heres-why-im-interested/comment-page-1#comment-143799 Joshua Guffey Tue, 16 Mar 2010 05:58:08 +0000 http://marshallk.com/?p=800#comment-143799 I'm pretty interested in big data too. I've Benny fascinated with the implications hi h to me are glaring and yet most people seem relatively un impressed by the stagering nature of what's staring us in the face. The whole world and everything we know is being irreversably transfigured and these changes are coming nearly instantaneously. I'm interested also in the concept of our progression as having an exponential growth curve rather than a linear one. Google "the singularity" for some interesting reading. Some of it is doom and gloom, just skip that crap and read the crazy speculations. Oh and follow me on Twitter. =P -Joshua I’m pretty interested in big data too. I’ve Benny fascinated with the implications hi h to me are glaring and yet most people seem relatively un impressed by the stagering nature of what’s staring us in the face.

The whole world and everything we know is being irreversably transfigured and these changes are coming nearly instantaneously.

I’m interested also in the concept of our progression as having an exponential growth curve rather than a linear one.

Google “the singularity” for some interesting reading. Some of it is doom and gloom, just skip that crap and read the crazy speculations.

Oh and follow me on Twitter. =P

-Joshua

]]> By: Addy http://marshallk.com/why-big-data-heres-why-im-interested/comment-page-1#comment-143626 Addy Sat, 13 Mar 2010 16:26:59 +0000 http://marshallk.com/?p=800#comment-143626 I got interested in big data after watching the last TED video on Open Standards and data, I was so excited about it i even posted an article on my blog about it! After some research i found out that it's actually our right to demand data from companies out there (some which i won't mention and that have not opened up their data to anyone) What was particularly interesting to see is the connections that linked data offers us and that's what people and companies can tap into to provide rich & helpful experience to so many people out there. In the future I'm sure we can see data interopability between our favorite social networks, because at this stage that isn't totally possible yet. Excuse my lack of in the comment. This is something really exciting. BTW everyone just because you're small, doesn't mean you can't contribute - Try starting here: http://www.okfn.org/ I got interested in big data after watching the last TED video on Open Standards and data, I was so excited about it i even posted an article on my blog about it!

After some research i found out that it’s actually our right to demand data from companies out there (some which i won’t mention and that have not opened up their data to anyone)

What was particularly interesting to see is the connections that linked data offers us and that’s what people and companies can tap into to provide rich & helpful experience to so many people out there.

In the future I’m sure we can see data interopability between our favorite social networks, because at this stage that isn’t totally possible yet.

Excuse my lack of in the comment. This is something really exciting. BTW everyone just because you’re small, doesn’t mean you can’t contribute – Try starting here: http://www.okfn.org/

]]> By: In Case You Missed It. Weekend Tech Reading http://marshallk.com/why-big-data-heres-why-im-interested/comment-page-1#comment-143614 In Case You Missed It. Weekend Tech Reading Sat, 13 Mar 2010 11:46:17 +0000 http://marshallk.com/?p=800#comment-143614 [...] Why Big Data? Here’s Why I’m Interested I just had my 2nd conversation this morning before coffee about this fabulous Economist special report on Big Data. Source: Marshallk [...] [...] Why Big Data? Here’s Why I’m Interested I just had my 2nd conversation this morning before coffee about this fabulous Economist special report on Big Data. Source: Marshallk [...]

]]> By: JoelGibby http://marshallk.com/why-big-data-heres-why-im-interested/comment-page-1#comment-143595 JoelGibby Sat, 13 Mar 2010 06:14:32 +0000 http://marshallk.com/?p=800#comment-143595 WOW - what interesting comments. I hope we see some others weigh in as well. Just tremendous. Marko: On customer loyalty rewards: that alone is a tremendous amount of data that belongs to it's creator: you/us -- When we get access to that data (probably not through the rewarding organization, but through a service like Blippy) we can begin to make some cool decisions based on it. WOW – what interesting comments. I hope we see some others weigh in as well. Just tremendous. Marko: On customer loyalty rewards: that alone is a tremendous amount of data that belongs to it’s creator: you/us — When we get access to that data (probably not through the rewarding organization, but through a service like Blippy) we can begin to make some cool decisions based on it.

]]> By: Peter Evans-Greenwood http://marshallk.com/why-big-data-heres-why-im-interested/comment-page-1#comment-143466 Peter Evans-Greenwood Thu, 11 Mar 2010 00:24:39 +0000 http://marshallk.com/?p=800#comment-143466 We already have more data than we can usefully deal with in most instances. BI seems to have hit it's limits and we need to find new ways to extract weak signals[1]. Tesco's (fairly) recent efforts to integrate weather forecasts[2] with till data is a pointer in the right direction. A rise of 10C, for example, led to a 300% uplift in sales of barbecue meat and a 50% increase in sales of lettuce. The challenge we have, which DC CROWLEY points to, is finding the data that matters. Not all information is of equal value[3]. As Chris Hall points out, the earlier we can get to a customer, the likely we are to be able to service their need exactly when they want it. (Though I still see this as reactive rather than predictive — the key difference is that we're using externally sensed data to identify the client need, rather than mining trends from internally manufactured data.) There's a whole thread on this that ping-pongs between my blog, and Andy Mulholland's blog at Capgemini. You can find my side of the discussion here: http://peter.evans-greenwood.com/category/focus/value-of-information-focus/ Oh — and when did "Big Data" become a proper noun :) r. PEG 1. Why scanning more data will not necessarily help BI http://peter.evans-greenwood.com/2009/12/22/why-scanning-more-data-will-not-necessarily-help-bi/ 2. Tesco’s looking outside the building to predict customer needs http://peter.evans-greenwood.com/2009/09/09/tesco-looking-outside-the-building-to-predict-customer-needs/ 3. Inside vs. outside: the value of information http://peter.evans-greenwood.com/2009/08/31/inside-vs-outside/ We already have more data than we can usefully deal with in most instances. BI seems to have hit it’s limits and we need to find new ways to extract weak signals[1]. Tesco’s (fairly) recent efforts to integrate weather forecasts[2] with till data is a pointer in the right direction. A rise of 10C, for example, led to a 300% uplift in sales of barbecue meat and a 50% increase in sales of lettuce.

The challenge we have, which DC CROWLEY points to, is finding the data that matters. Not all information is of equal value[3]. As Chris Hall points out, the earlier we can get to a customer, the likely we are to be able to service their need exactly when they want it. (Though I still see this as reactive rather than predictive — the key difference is that we’re using externally sensed data to identify the client need, rather than mining trends from internally manufactured data.)

There’s a whole thread on this that ping-pongs between my blog, and Andy Mulholland’s blog at Capgemini. You can find my side of the discussion here:

http://peter.evans-greenwood.com/category/focus/value-of-information-focus/

Oh — and when did “Big Data” become a proper noun :)

r.

PEG

1. Why scanning more data will not necessarily help BI
http://peter.evans-greenwood.com/2009/12/22/why-scanning-more-data-will-not-necessarily-help-bi/

2. Tesco’s looking outside the building to predict customer needs
http://peter.evans-greenwood.com/2009/09/09/tesco-looking-outside-the-building-to-predict-customer-needs/

3. Inside vs. outside: the value of information
http://peter.evans-greenwood.com/2009/08/31/inside-vs-outside/

]]> By: Chris Hall http://marshallk.com/why-big-data-heres-why-im-interested/comment-page-1#comment-143451 Chris Hall Wed, 10 Mar 2010 19:46:40 +0000 http://marshallk.com/?p=800#comment-143451 I'm really interested in matching up what people search for and what they say in status updates with what they do in real life. I think that cracking the predictive analysis nut will do a lot of good toward ensuring that consumers have exactly what they want - be it information, products, or services - exactly when and where they want it. I’m really interested in matching up what people search for and what they say in status updates with what they do in real life. I think that cracking the predictive analysis nut will do a lot of good toward ensuring that consumers have exactly what they want – be it information, products, or services – exactly when and where they want it.

]]> By: marko anderson http://marshallk.com/why-big-data-heres-why-im-interested/comment-page-1#comment-143450 marko anderson Wed, 10 Mar 2010 19:37:22 +0000 http://marshallk.com/?p=800#comment-143450 mega problem = mega opportunity mega problem = mega opportunity

]]> By: DC Crowley http://marshallk.com/why-big-data-heres-why-im-interested/comment-page-1#comment-143448 DC Crowley Wed, 10 Mar 2010 19:14:32 +0000 http://marshallk.com/?p=800#comment-143448 Big data - Archiving (big problem) - The speed of technology going obsolete before we can process everything, let alone understand it. - We are incapable of properly understanding or analyzing vast amounts of data. - Which data is meaningful and how can we spot it? Is semantics enough? We have a mega problem. Big data
- Archiving (big problem)
- The speed of technology going obsolete before we can process everything, let alone understand it.
- We are incapable of properly understanding or analyzing vast amounts of data.
- Which data is meaningful and how can we spot it? Is semantics enough?

We have a mega problem.

]]> By: marko anderson http://marshallk.com/why-big-data-heres-why-im-interested/comment-page-1#comment-143440 marko anderson Wed, 10 Mar 2010 17:17:16 +0000 http://marshallk.com/?p=800#comment-143440 Agree. Fasten your sealtbelts, its going to be an enjoyable ride :) An intro to something i was wrote recently.... The world is digital. Nearly everything we do leaves personal digital trails in our wake; from communications, to media consumption, to purchases, to financial transactions, to healthcare. We are already seeing some of the early tangible benefits that this data can generate for us such as, customer loyalty rewards, book and music recommendations, and better medical prognosis. This rapidly increasing digitization of our activities is creating an ever-expanding pool of raw material from which we could potentially realize great benefit for ourselves and others. As this data is becoming more connected via the internet and accessible via open standards, it is a natural progression that more extensive collections of our data will be aggregated into rich personal data repositories. These personal data assets will not exist in isolation, but will be integrated parts of much larger data platforms. These large-scale user data platforms will enable exciting new experiences and interfaces that will allow us to gain deeper insights about ourselves, and our complex interconnections to the people and things around us. The current benefits we are seeing now are trivial compared to what will be possible in the near future when massive data platforms emerge with the ability to aggregate vast quantities and varieties of real-time data about nearly everything. These systems will be the catalyst for an evolutionary shift in our most basic and fundamental understanding about ourselves and our connections to the world we live in. Agree. Fasten your sealtbelts, its going to be an enjoyable ride :) An intro to something i was wrote recently….

The world is digital. Nearly everything we do leaves personal digital trails in our wake; from communications, to media consumption, to purchases, to financial transactions, to healthcare. We are already seeing some of the early tangible benefits that this data can generate for us such as, customer loyalty rewards, book and music recommendations, and better medical prognosis. This rapidly increasing digitization of our activities is creating an ever-expanding pool of raw material from which we could potentially realize great benefit for ourselves and others. As this data is becoming more connected via the internet and accessible via open standards, it is a natural progression that more extensive collections of our data will be aggregated into rich personal data repositories. These personal data assets will not exist in isolation, but will be integrated parts of much larger data platforms. These large-scale user data platforms will enable exciting new experiences and interfaces that will allow us to gain deeper insights about ourselves, and our complex interconnections to the people and things around us. The current benefits we are seeing now are trivial compared to what will be possible in the near future when massive data platforms emerge with the ability to aggregate vast quantities and varieties of real-time data about nearly everything. These systems will be the catalyst for an evolutionary shift in our most basic and fundamental understanding about ourselves and our connections to the world we live in.

]]> By: Altan Khendup http://marshallk.com/why-big-data-heres-why-im-interested/comment-page-1#comment-143439 Altan Khendup Wed, 10 Mar 2010 17:14:55 +0000 http://marshallk.com/?p=800#comment-143439 I share and like your concepts as well. In my recent projects taking data from a variety of sources which may seem unrelated and cross referencing them creates new and fascinating insights, and uncovers patterns that were undiscovered. Overall companies are having a lot of growing interest in this concept though are wrestling a lot with exactly how to tackle it. I am sure RWW has lots of interesting findings as well :) I share and like your concepts as well. In my recent projects taking data from a variety of sources which may seem unrelated and cross referencing them creates new and fascinating insights, and uncovers patterns that were undiscovered. Overall companies are having a lot of growing interest in this concept though are wrestling a lot with exactly how to tackle it. I am sure RWW has lots of interesting findings as well :)

]]> By: JoelGibby http://marshallk.com/why-big-data-heres-why-im-interested/comment-page-1#comment-143438 JoelGibby Wed, 10 Mar 2010 17:13:44 +0000 http://marshallk.com/?p=800#comment-143438 Big Data is more than just Wolfram Alpha. It is the entire http realm. Anything that is publicly fetchable via http is game (though if you rely on Google API, you may not be seing the whole story). If you stick to Twitter API, you'll only see noteworthy links to data (you'll have to parse the text and that's a TOUGH problem), but you'll also be affected by the "echo chamber" effect. The dialog here and elsewhere discussing big data is the first steps. Once developers, hackers, collaborators begin hacking away at the problem, if even to prove it is possible with a subset of the BigData, we'll see results soon after. Thanks for sharing, keep the discussion flowing, and hope to see more soon! Big Data is more than just Wolfram Alpha. It is the entire http realm. Anything that is publicly fetchable via http is game (though if you rely on Google API, you may not be seing the whole story). If you stick to Twitter API, you’ll only see noteworthy links to data (you’ll have to parse the text and that’s a TOUGH problem), but you’ll also be affected by the “echo chamber” effect. The dialog here and elsewhere discussing big data is the first steps. Once developers, hackers, collaborators begin hacking away at the problem, if even to prove it is possible with a subset of the BigData, we’ll see results soon after.

Thanks for sharing, keep the discussion flowing, and hope to see more soon!

]]>