Inductive Bias

Building online communities - from the 0MQ trenches

November 13, 2013
Uncategorized

Building online communities - from the 0MQ trenches # After seeing several talks on how open source communitites are organised at FOSDEM, on how to license open source software strategically at Chemnitzer Linuxtage and on how to nurture open source communities at Berlin Buzzwords over the past couple of years during the past year or so I’ve come to read quite a few articles and books on the art of building online communities. ...

Wonder if you should switch from your RDBMS to Apache Hadoop: Don't!

August 26, 2013
Hadoop, NOSQL, rdbms

Wonder if you should switch from your RDBMS to Apache Hadoop: Don’t! # Last weekend I spend a lot of fun time at FrOSCon* in Sankt Augustin - always great to catch up with friends in the open source space. As always there were quite a few talks on NoSQL, Hadoop, but also really solid advise on tuning your system for stuff like MySQL (including a side note on PostgreSQL and Oracle) from Kristian Köhntopp. ...

JAX: Project Nashorn

May 24, 2013
nashorn, jvm, Event, JAX, js

JAX: Project Nashorn # The last talk I went to was on project Nashorn - demonstrating the capability to run dynamic languages on the JVM by writing a JavaScript implementation as a proof of concept that is fully ECMA compliant and still performs better than Mozilla’s project Rhino. It was nice to see Lisp, created in 1962, referenced as being the first language that featured a JIT compiler as well as garbage collection. ...

JAX: Tales from production

May 23, 2013
logging, Java, Event, JAX

JAX: Tales from production # In a second presentation Peter Roßbach together with Andreas Schmidt provided some more detail on what the topic logging entails in real world projects. Development messages turn into valuable information needed to uncover issues and downtime of systems, capacity planning, measuring the effect of software changes, analysing resource usage under real world usage. In addition to these technical use cases there is a need to provide business metrics. ...

JAX: Logging best practices

May 22, 2013
logging, Java, Event, JAX

JAX: Logging best practices # The ideal outcome of Peter Roßbach’s talk on logging best practices was to have attendees leave the room thinking ``we know all this already and are applying it successfully’’ - most likely though the majority left thinking about how to implement even the most basic advise discussed. From his consultancy and fire fighter background he has a good overview of what logging in the average corporate environment looks like: No logging plan, no ...

JAX: Java performance myths

May 22, 2013
performance, myth, Java, Event, JAX

JAX: Java performance myths # This talk was one of the famous talks on Java performance myths by Arno Haase. His main point - supported with dozens of illustrative examples was for software developers to stop trusting in word of mouth, cargo cult like myths that are abundant among engineers. Again the goal should be to write readable code above all - for one the Java compiler and JIT are great at optimising. ...

JAX: Does parallel equal performant?

May 21, 2013
performance, Java, Event, JAX

JAX: Does parallel equal performant? # In general there is a tendency to set parallel implementations to being equal to performant implementations. Except in the really naive case there is always going to be some overhead due to scheduling work, managing memory sharing and network communication overhead. Essentially that knowledge is reflected in Amdahl’s law (the amount of serial work limits the benefit from running parts of your implementation in parallel, http://en. ...

JAX: Pigs, snakes and deaths by 1k cuts

May 20, 2013
performance, Java, Event, JAX

JAX: Pigs, snakes and deaths by 1k cuts # In his talk on performance problems Rainer Schuppe gave a great introduction to which kinds of performance problems can be observed in production and how to best root-cause them. Simply put performance issues usually arise due to a difference in either data volumn, concurrency levels or resource usage between the dev, qa and production environments. The tooling to uncover and explain them is pretty well known: ...

JAX: Java HPC by Norman Maurer

May 19, 2013
performance, Event, JAX, netty

JAX: Java HPC by Norman Maurer # For slides see also: Speakerdeck: High performance networking on the JVM Norman started his talk clarifying what he means by high scale: Anything above 1000 concurrent connections in his talk are considered high scale, anything below 100 concurrent connections is fine to be handled with threads and blocking IO. Before tuning anything, make sure to measure if you have any problem at ...

JAX: Hadoop overview by Bernd Fondermann

May 18, 2013
BigDataCon, Hadoop, JAX, Event

JAX: Hadoop overview by Bernd Fondermann # After breakfast was over the first day started with a talk by Bernd on the Hadoop ecosystem. He did a good job selecting the most important and interesting projects related to storing data in HDFS and processing it with Map Reduce. After the usual "what is Hadoop", "what does the general architecture look like", "what will change with YARN" Bernd gave a nice overview of which ...