The failure of open science

Michael Nielsen has a great post on why open science is failing to take off. His main point is that science was never that open to start with, but thanks to the communication needs of the time and the technology available people developed the peer review system. A system that is now hauting us, while top scientists disregard current technology (mostly web-based) that makes the current system look silly.

By the way, Nielsen knows what he is talking about; he wrote the standard text on quantum computation the most highly cited physics publication of the last 25 years according to Google Scholar.

The first example he uses is Nature’s open peer review system:

Inspired by the success of amazon.com and similar sites, several organizations have created comment sites where scientists can share their opinions of scientific papers. Perhaps the best-known was Nature’s 2006 trial of open commentary on papers undergoing peer review at Nature. The trial was not a success. Nature’s final report terminating the trial explained: There was a significant level of expressed interest in open peer review… A small majority of those authors who did participate received comments, but typically very few, despite significant web traffic. Most comments were not technically substantive. Feedback suggests that there is a marked reluctance among researchers to offer open comments.

His second example is the usual suspect: wikipedia.

John Seigenthaler Sr. has described Wikipedia ...

Seigenthaler has described Wikipedia as "a flawed and irresponsible research tool".

Nielsen marvels as scientists missing the point of wikipedia:

[...] You’ve bought into the current game, and take it for granted that science is only about publishing in specialized scientific journals. But if you take a broader view, you believe science is about discovering how the world works, and sharing that understanding with the rest of humanity.

[Read more...]

And the academic most likely to accidentally eradicate human life is…

Ok, this is just a quick, relaxing post.
In your view who is the academic most likely to accidentally eradicate human life?

The wisdom of crowds or what this blog is about

Following up on Jose’s musings on good and bad keywords for a productivity blog, I came across an interesting tool to visualize the evolution over time of aggregated social bookmarking tags for popular websites. It is actually a pretty old project called Cloudalicious created a few years ago by Terrell Russell (of ClaimID fame).

If you are a web metrics maniac like yours truly, you won’t resist plugging this tool into your favourite websites, so here’s the graph I generated for AcademicProductivity.com:

Tags for ap.com over time

(source)

[Read more...]

Rethinking life hacks

“Math is hard; let’s go shopping!”

-hacked Barbie

Summary: It looks like the difficulties of measuring  productivity make people use common sense to give advice on how to improve it instead of actually attacking productivity as a hard problem that needs empirical study. But people do follow barely tested advice on productivity. They are either too busy to afford dismissing it, or too pragmatic to believe that we can reach systematic, scientific productivity techniques.

There is a current craze about productivity in many forms (sometimes disguised as personal development). At least 4 of the top 100 blogs in the blogosphere are about productivity (according 3038597_e5f95e2017_mto technorati’s authority: lifehacker #6; Zen Habits #41; lifehack.org #66 43 Folders #73). There’s a current craze about personal productivity and personal development. The best treatment I have read recently is Cal Newport’s Flak magazine article

In fact, lifehacking is a trend of the 21st century. The idea is to reduce the things that bother you in your life (or reduce the time it takes to complete them) while increasing the quality and quality of the experiences that you like. This is pretty intuitive, but is this a working definition of whatever personal productivity is? Hardly. Today, anything that solves an everyday problem in a clever or non-obvious way might be called a life hack.

Hacks are by definition, unsystematic. Everything goes, as long as it works. This is the contrary to the incremental evolution of scientific thinking. Even though sometimes there are large changes in the form of paradigm shifts, most of the time progress is incremental and lineal.

The advantages are clear: one can build on the knowledge acquired by the previous generation.

But do we have the same incremental progress in personal productivity theories? If there anything remotely similar to a science of productivity? Should people follow only empirically tested advice about productivity?

[Read more...]

We are now a^H^H^H^H^H^H^H^H productivity blog

I always wondered how people see the academic world from outside. How do we gauge the interest of the general public on what academics have to say (on average)? One easy way to look at this question is to see the how often people will read an article that has the word ‘academic’ on it.

A proxy on what people read nowadays is digg.com. And the tool to see how often people digg academic posts is now available in Dan Zarella’s blog. Given a keyword, the tool will return data on the average number of links accumulated by stories popular on Digg that mentioned that keyword. This is done with 2007 data.

Well, behold what happens when you enter “academic”:

clipboard2_21_2008 _ 19_07_34

And compare it to what you get when you type “productivity”:image

Why is this important? Well, on average, a single digg increases traffic by 0.10%. So a story that gets 3,000 diggs results in an increase in total traffic to the referring site by 300%.

So, from now on we are a^H^H^H^H^H^H^H^H productivity blog :)