Damn data (17 oktober 2013)


Midden oktober schoof ik aan voor het tech event rond “Big Data”, georganiseerd door de jongens van Combell en IdeaLabs: Damn Data!

Waarom “Damn Data”?
“We’d like to remind our audience that not everything is a damn SQL statement”

Voor een eerste editie is dit meer dan geslaagd: goeie organisatie, leuke ruimte en smakelijk eten en bijhorende drank. Nadien Vedett à volonté!
Ook inhoudelijk hebben ze wel wat potten gebroken: in plaats van de typische set te programmeren rond de hype van “big data”, hebben ze’t meer technische en pragmatisch aangepakt. Er was een goeie mix tussen lokale helden (Steven Noels – NGData; Wim Van Leuven – Bigdata.be; …), en de grotere gevestigde waarden (Ross Lawley – MongoDB; Chaitanya Mishra – Facebook; …)

Wat heb ik genoteerd?

  • Je big data architectuur is sterk afhankelijk van de applicatie die aan het bouwen bent, idem voor de technologische keuzes;
  • My Hadoop is bigger than yours” blijkt een populair t-shirt te zijn;
  • Facebook gebruikt een eigen systeem voor real time adhoc analyses (Presto), en heeft dat ook gedeeld naar de rest van de wereld;
  • Facebook doet per pageview ongeveer 3 queries naar de database. De overige 1200 items komen integraal uit de cache. Per pageview verschepen ze 200kB aan data, en dat een paar miljard keer per dag;
  • Facebook gelooft in “developing objects that do one thing only, but do it really really well”;
  • Storm is “the new kid on the block”, dat aan distributed realtime computation doet. Concreet: processing benchmarks van 1 miljoen records per seconde, per node zijn vrij indrukwekkend;
  • Bij de start van een nieuw “big data” project is het belangrijk om “skinny” te beginnen, in plaats van onmiddelijk de “big guns” binnen te halen. Die komen ongetwijfeld later nog aan bod …;

24 thoughts on “Damn data (17 oktober 2013)”

  1. Can I simply just say what a comfort to uncover somebody that genuinely understands what they’re talking about on the net.
    You actually realize how to bring an issue to light and make it important.
    More people have to check this out and understand this side of the story.
    I was surprised you aren’t more popular given that you certainly possess the gift.

  2. I’d like to thank you for the efforts you have put in writing this
    blog. I’m hoping to check out the same high-grade
    content from you in the future as well. In truth, your
    creative writing abilities has encouraged me to get my own site now 😉

  3. At this time it seems like Drupal is the preferred blogging platform out there right now.
    (from what I’ve read) Is that what you are using on your blog?

  4. I do not know whether it’s just me or if perhaps everybody else experiencing issues with your blog.

    It looks like some of the text in your content are running off the screen. Can somebody else please provide feedback
    and let me know if this is happening to them as well?
    This might be a issue with my internet browser because I’ve had this
    happen previously. Kudos

  5. Hi, Neat post. There’s a problem together with your site in web explorer,
    would test this? IE still is the market chief and a large section of other people will omit your wonderful writing due to this problem.

  6. Great site. Lots of useful information here. I am sending
    it to several friends ans additionally sharing in delicious.
    And of course, thank you to your sweat!

  7. I don’t even understand how I ended up here, but I
    believed this post was great. I do not realize who you might be however certainly you are going to a well-known blogger should you are not already.

  8. Thanks for ones marvelous posting! I genuinely enjoyed reading it, you
    are a great author.I will remember to bookmark your blog and
    will eventually come back later in life. I want to encourage
    you to continue your great job, have a nice weekend!

  9. Hey there! Would you mind if I share your blog with my zynga group?
    There’s a lot of people that I think would really appreciate your content.
    Please let me know. Many thanks

  10. I absolutely love your blog.. Pleasant colors & theme.
    Did you develop this amazing site yourself? Please reply back as I’m planning to create
    my own personal website and would like to find out where you got this from
    or just what the theme is called. Thanks!

  11. Hello! I just want to give you a big thumbs up for
    your excellent information you have right here on this post.
    I’ll be returning to your web site for more soon.

  12. Thank you for the auspicious writeup. It in truth was a amusement account it.

    Look complicated to more introduced agreeable from you!
    However, how can we be in contact?

  13. Attractive section of content. I just stumbled upon your website and in accession capital to assert that I acquire in fact enjoyed account your blog posts.
    Any way I will be subscribing to your augment and even I achievement you access consistently quickly.

  14. Do you mind if I quote a couple of your posts as long as I provide credit and sources back to your blog?
    My website is in the exact same area of interest as yours and my visitors would certainly benefit from some of the information you provide here.
    Please let me know if this okay with you.
    Many thanks!

  15. Hey there would you mind stating which blog platform you’re working with?
    I’m looking to start my own blog soon but I’m having a tough
    time making a decision between BlogEngine/Wordpress/B2evolution and Drupal.

    The reason I ask is because your design seems different then most blogs and I’m looking for something unique.
    P.S Sorry for getting off-topic but I had to ask!

  16. Hey! I know this is somewhat off topic but I was wondering which blog platform are
    you using for this website? I’m getting fed up of WordPress because I’ve had problems with hackers and I’m
    looking at options for another platform. I would be great if you could point me in the direction of a
    good platform.

Leave a Comment

Het e-mailadres wordt niet gepubliceerd.