Academic Productivity

Google will host large scientific datasets at http://research.google.com. That is, of you have a dataset that is requested constantly, now you can ‘open-source’ it and let google take the server load. Wired has this covered.

For those not seeing the point in having open, portable data, this presentation (Making Massive Datasets Universally Accessible and Useful) is a good an explanation.

How do you ship a large dataset to google? Well, they send you hard drives in a suitcase!:

(Google people) are providing a 3TB drive array (Linux RAID5). The array is provided in “suitcase” and shipped to anyone who wants to send they data to Google. Anyone interested gives Google the file tree, and they SLURP the data off the drive. I believe they can extend this to a larger array (my memory says 20TB).

If you enjoyed this post, make sure you sign up for our mailing list or subscribe to our RSS feed!

Sara Lloyd has published a manifesto on the way knowledge is distributed today.

In an ‘always on’ world in which everything is increasingly digital, where content is increasingly fragmented and ‘bite-sized’, where ‘prosumers’ merge the traditionally disparate roles of producer and consumer, where search replaces the library and where multimedia mash-ups -not text- holds the attraction for the digital natives who are growing up fast into the mass market of tomorrow, what role do publishers still have to play and how will they have to evolve to hold on to a continuing role in the writing and reading culture of the future?

This is important since the publishing industry somehow determines how academics allocate their time. If you can communicate your ideas in a way that fits the current standards, you may get them to spread farther.

Another interesting point is how the development of the text itself and the writing and editing process is now often ‘open’: there are ‘beta’ books on the net, and readers, ‘debug’ chapters as soon as the author releases them. This is a fantastic model that could leave professional editors out of the equation and speed up publishing in general. But then, do you really need the paper version of the book when all is said and done? Do you need to make a trip to the library to get it?

Oh, and by the way, Adobe acrobat 9 is out and now you can embed flash (i.e., video) in it. This makes possible to create a book that contains talks; or 3D rotations of a complex data visualization. Yet another reason to pay attention to fully digital book distribution.

If you enjoyed this post, make sure you sign up for our mailing list or subscribe to our RSS feed!

Paul Graham does it again. It’s great when you have a mind used to solve problems with simple solutions applied to time management. The more everyday problems hackers manage to solve (this time without use of fancy technology), the better for all of us.

The basic idea is simple: just make your body aware that you are wasting time. It’s even more radical than my interruptron idea of having a time counter growing in size as a function of wasting time.

I can find at least two problems with this idea. Or maybe I’m just trying to rationalize that I don’t want them to pry ‘my precious’ internet from my tired fingers

1. Software updates. I find that I quite often have to do a ’sudo aptitude install’ or some such. At least a couple of times a day. Same for programming languages’ packages. It’d be a pain to switch on the internet for that, plus it’d be tempting to leave it on.
2. Mail. I often have a quick idea and fire off an email to someone who may need to know or do something about it. My mail reader is integrated with my browser and sending a new mail is just one shortcut away. Again, a bit of a pain to move to a different computer to send a mail.

Still, the advantages are huge. Having no interruptions whatever online? Sounds great. In fact, when I’m really feeling like I need to get something done, I retire to a library with no wireless (and hopefully a comics section to fill scheduled rest time).

I’m interested in this method (2nd computer for internet only) enough to give it a serious try, say a full month.

It’d be great if more people wanted to join a trial, so we can do some n>1 testing on whether this works overall or not. It’d be also great to have some accountability (i.e., people knowing that you are doing this trial, so you feel ashamed if you are not following the rules). The problem is that productivity measures will have to be subjective: i.e., at the end of the month, do you feel you have gotten a lot done? More than any other month while you were online at all times?

What do you think?

PS: there’s a full thread commenting the article here.

If you enjoyed this post, make sure you sign up for our mailing list or subscribe to our RSS feed!

Extremely productive company 37signals (authors of  Ruby on Rails) have a short but interesting post on workaholism. It seems that workaholics actually create situations that require more work. This makes sense. And there are plenty of opportunities to fabricate more work: focus on small, inconsequential details; say yes to things before you have finished what you are currently working on; have no idea how long it’ll take to finish your current project (this is a big one for programming), etc.

The problem is that many work environments actually encourage people to act the workaholic way (and look busy all the time). If your workplace is one of these, there’s little you can do.

I’m still not seeing any stats that prove that non-workaholics get more done than workaholics though

If you enjoyed this post, make sure you sign up for our mailing list or subscribe to our RSS feed!

There’s an excellent discussion at news.ycombinator on why one should _not_ pursue an academic career. The post started with the ‘don’t become a scientist‘ article by Jonathan I. Katz that we commented before. What I find interesting is that ycombinator represents a population of very smart people (hackers and startup founders) who are not academics but most probably have had offers to go to grad school/take a postdoc, etc and declined them to start a new company.

Some members describe their experience as research programmers for big-name research groups, and it’s not pretty. Menloparkbum says:

Most of the people working there were like people working at any big, lame bureaucratic institution, only they had or were obtaining PhDs. Most of their time was spent surfing the web, sending email, and attending meetings. I have never worked anywhere else where people attended so many meetings.

User amichail says:

Don’t be misled by the promise of freedom in academia. It’s not like that at all. [...]

Unless you get a faculty position at a stellar university (highly unlikely nowadays), the teaching will be depressing. And your research will suffer as a result since you will be in no mood to do it.

Also, unless you plan to do everything yourself for research, you will need to get some funding. But whether you get that funding depends on whether your peers — competitors actually — like what you plan to do.

Not much that we didn’t know here. But why are threads like this surfacing more often recently? Or is it just me who finds them everywhere? I don’t even log into the Chronicle forums because the numbers of complains (’I have no life’) there are depressing. This particular user group (Hackers and startup founders) are perfect examples of people who pick on new trends and evaluate what a market is offering. They seem to be all in agreement: steer away from an academic career.

What do you think?

If you enjoyed this post, make sure you sign up for our mailing list or subscribe to our RSS feed!

The efficient academic google group has a thread on a really interesting problem. Any hack addressing this has a high chance of saving several hours per week for those of you who teach.

Given lecture material has three components:

1. Slides for digital projection (preferable PDFs rather than PowerPoint or Keynote)
2. Lecture notes to support what I need to say and remember
3. Lecture handout

I regularly update all three, but I am finding keeping all three in sync to be a bit tedious.

I’m not sure what the solution is, but what I am visualising is some sort of single document, where you  write the lecture handout. I could then update this with new information between presenting the lecture.

If you have a solution, drop by and post it there (or here!).

If you enjoyed this post, make sure you sign up for our mailing list or subscribe to our RSS feed!

WordFlashReader has several advantages over the previously analyzed rapidReader: it’s open source, and written in perl. So it works under linux and windows at least. wordflashreader also highlights where you are reading, so one of the downsides of RSVP (disorientation) is mostly gone. Still, you lose the formatting when you read HTML or PDF… and the highlighting didn’t work very well for me. The way cursors change speed make it confusing (I’m too used to move around the document with cursor keys). One nifty idea is to go back one sentence with left control key.

As before, of you can test it out and post your thoughts for everyone to see, that’d be great.

Another option we commented before was spreeder.

I’m still looking for the holy Grail that makes my reading more fluid and effective. It looks like this is an interest that I share with many people according to the huge pile of books that amazon lists for ’speed reading’.

If you enjoyed this post, make sure you sign up for our mailing list or subscribe to our RSS feed!

Do you need to write code in your academic work? Have you read someone else’s code? Did you just get  a code attachment with a warning like “this is a mess, I need to clean this up someday?”. Well, you are not alone. It seems that in the industry, telling someone that you plan to use code that comes straight from an academic makes them feel a drop of cold sweat down their backs.

American scientist has an article on these common practices that we have managed to avoid for so long.

I therefore started asking scientists how they wrote their programs. The answers were sobering. Whereas a few knew more than most of the commercial software developers I’d worked with, the overwhelming majority were still using ancient text editors like Vi and Notepad, sharing files with colleagues by emailing them around and testing by, well, actually, not testing their programs systematically at all.

I finally asked a friend who was pursuing a doctorate in particle physics why he insisted on doing everything the hard way. Why not use an integrated development environment with a symbolic debugger? Why not write unit tests? Why not use a version-control system? His answer was, “What’s a version-control system?”

The paper advocates the use of version-control, proper editors and IDEs, and unit testing. These three things are great practices, and in my experience we academics either don’t use them or had to learn them ‘on-the-wild’ after banging our heads on a wall. And it shows.

Our code could be tidier. The bad news is that this reputation seems not to be restricted to code tidiness.

The unqualified-reservations blog has a (long) post on how CS research in the academia is considered outside:

…anyone who’s not involved in CS research treats the products of this endeavor as if they were smallpox-infected blankets. Even when it is clearly - in my opinion - good, it winds up ignored. Because of the inescapable grant-related propaganda, it’s impossible to tell what’s good and what’s not.

The gist of his main point is that usefulness and relevance are almost inversely related to academic value. That gives academics the ‘freedom’ to write unmanageable code; as long as it produces a paper (and note that code is not provided with the paper) you are fine. A caricature: a guy invents a programming language (say python) that is used by millions included google. It has zero academic value. Another guy writes and obscure paper (or hundreds) on a topic that is irrelevant even to his mom. That second guy gets grant money, tenure. Sounds familiar?

If you enjoyed this post, make sure you sign up for our mailing list or subscribe to our RSS feed!

This is quite a finding; I’m still wondering how a paper that basically says: “academics are sluts” got accepted in a peer reviewed journal. Kudos to the editor.

Frey, B. S. (2002) Publishing as prostitution? – Choosing between one’s own ideas and academic success. Public choice, 116: 205-223

Here’s an excerpt:

The author knows that, normally, he would be lucky if, after something like a year or so, he gets an invitation to resubmit the paper according to the demands exactly spelled out by the two to three referees and the editor(s). For most scholars, this is a proposal that cannot be refused, because their survival in academia crucially depends on publications in refereed professional journals. They are well aware of the fact that they only have a chance to get the paper accepted if they slavishly follow the demands formulated. The system of journal editing existing in our field at the present time virtually forces academics to become prostitutes: they sell themselves for money (and a good living). Unlike prostitutes who sell their bodies for money (Edlund and Korn, 2002), academics sell their soul to conform to the will of others, the referees and editors, in order to gain one advantage, namely publication. Most persons
refusing to prostitute themselves and to follow the demands of the system are not academics: they cannot enter, or have to leave, academia because they fail to publish. Their integrity survives, but the persons disappear as academics.

Surprising as the title might be, the paper actually proposes yet another solution to the peer-review conundrum. It’s a system that pretty much everybody agrees is broken but nobody has been able to fix.

The solution: remove the veto powers from the reviewers. Use the editor’s feeling as the only criterion. Why? Because the editor is the only one who knows how the paper fares relative to other submissions to the journal, whereas the reviewers have to use “according to some mystical absolute standards rather than be able to select the relatively best paper from those submitted.”

PS: This paper has the longest acknowledgments list I’ve ever seen. It must have been hell to get it published

If you enjoyed this post, make sure you sign up for our mailing list or subscribe to our RSS feed!

In the last month or so (sorry, we haven’t posted in a month!) I’ve been reading on and thinking about attention economy. I think it is the right paradigm to connect the different bits and pieces of productivity knowledge (we could call them hacks) floating around on the ‘net.

I could write a long intro to the attention economy ideas and how they affect the way we process information AND make decisions… but I have written a series of 4 posts on attention economy and I’d better redirect you there. So, ideally, before you continue reading this post you should have at least skimmed that series, and you should be comfortable with it.

The question I want to address on this post is this: Are we rational about how we allocate attention? This is an important topic because attention allocation to different scientific topics can make or break your career.

(more…)

If you enjoyed this post, make sure you sign up for our mailing list or subscribe to our RSS feed!

NOTE: Thanks Terri Yu (Yale) for submitting this resource to ap.com.

UPDATE: Terri has posted on his blog a collection of notes on the Fisher Files, sequence II. This is a fantastic resource overall, more so if you prefer reading over listening.

The Fisher files is a weekly podcast that focuses on being ‘thoughtful’ -call it strategy- by connecting small actions with larger aims. In the words of the author:

In a single day, we perform over two hundred small tasks: dial a phone, sharpen a pencil, open the computer, begin to type a paragraph. How do we connect all those small task to the larger aims of our lives? Are we even aware of what the larger aims of our lives are?

I have thought more and more about making and maintaining the connections between the large and small. Sometimes, these connections just fall apart for me and I find myself doing useless and irrelevant things. Other times, some connections are there and strong and I have an almost spiritual sense of mindfulness. The way the connections help me translate large aims to small tasks is not so much about productivity as they are about relevance.

Peter is a GTD practitioner, although not all the techniques described in the GTD book were useful for him -and I suspect not all are applicable to academics.

(more…)

If you enjoyed this post, make sure you sign up for our mailing list or subscribe to our RSS feed!

Note: this is a contributed post by Cal Newport. If you like this, check his study hacks blog for more. If you have an interesting idea that supercharges your productivity and want to share it with our community, feel free to send it to us using the contact form. We’d certainly want to hear it!

-Jose

I’m a graduate student. A fourth year PhD candidate at MIT, to be precise. And I have an annoying habit. Whenever I get a chance to collaborate, chat, or hang around with successful professors in my field, I like to find out about their work habits. In doing so, I’ve discovered the following two trends:

1. The best young professors carve out a day each week to do nothing but research. This prevents the administrative nonsense that dominates their early professional lives from bringing their research momentum to a complete stop.
2. The best, distinguished, older professors — those who have earned light teaching schedules and have paid their dues on enough committees that in their final years before retirement can begin to untangle themselves from these obligations — isolate administrative nonsense to a small number of days. They might even, for example, have a single day each week to take care of this crap, and then spend the other four thinking big thoughts.

(more…)

If you enjoyed this post, make sure you sign up for our mailing list or subscribe to our RSS feed!

If you have followed ap.com for any amount of time, you have realized that I really like Paul Graham’s ideas. He has just published an essay where he uses data from his Y! combinator to prove that having a degree from an elite university does not increase your chances of being successful when going for a startup. He argues that the ’startup test’ is a lot more useful to infer a person’s value than the tests that she needs to pass to e.g., getting good grades during high school or getting accepted in a prestigious college: “a high school record that’s largely an index of obedience”. I agree. I think his logic is impeccable.

This new essay just adds on his idea of “prestige is just fossilized brilliance”. Elite institutions capitalize on prestige, but it is not clear -at least from Paul’s analysis- that prestige converts well into real-life success, which I guess is what companies try to hire for. I think academics fight for prestige (clearly, money is not the currency they fight for!). And I think prestige is the wrong thing to look for!

If you enjoyed this post, make sure you sign up for our mailing list or subscribe to our RSS feed!

From The Efficient Academic Google group. LyX, the WYSIWYG editor for LaTeX is getting better and better (although I don’t use it; once you are familiar with LaTeX, it’s faster to just write code). For those who may not know it, LyX is :

a document processor that encourages an approach to writing based on the structure of your documents, not their appearance. It is released under a Free Software / Open Source license.LyX is for people that write and want their writing to look great, right out of the box. No more endless tinkering with formatting details, ‘finger painting’ font attributes or futzing around with page boundaries. You just write. In the background, Prof. Knuth’s legendary TeX typesetting engine makes you look good. 

Technorati tags: latex, lyx, editing, typesetting, document, academic productivity, outliner

If you enjoyed this post, make sure you sign up for our mailing list or subscribe to our RSS feed!

From Mark J. Perry’s blog, I just learned that the average UAW worker with a high school degree earns 57.6% more compensation than the average university professor with a Ph.D. Considering that there are plenty of academic positions that do not enjoy the average salary mentioned in the blog post, this is something to worry about. Average Postdoc salaries according to the NSF are nowhere closer to this figure, and you have to add the uncertainty of these positions (they are always short-term) and mobility demands (expect to move to a different university sooner or later). And of course, academic work longer hours and suffer a lot more psychological stress than car factory workers.

Where did things go this wrong? Do our markets demand cars, and not knowledge? Is education so unimportant in our current economy? These statistics are borderline insulting, no matter how you try to justify them.

If you enjoyed this post, make sure you sign up for our mailing list or subscribe to our RSS feed!

Good writing is a skill. I’m not saying I have it, and remember, this is a blog post, maybe the fastest form of writing and reading ). As a skill, it requires practice. And, as Graham says, “Writing doesn’t just communicate ideas; it generates them. If you’re bad at writing and don’t like to do it, you’ll miss out on most of the ideas writing would have generated.”In fact, writing posts like this one is helping me to review and polish ideas I didn’t know I had about writing till this very moment. I’ll start with the most obvious, and will get more subtle/interesting as the list grows.

1. Get your relevant Manual of Style. (e.g., Chicago/APA). APA wants you to buy it in book form, but I think this is one of the resources that should be online.
2. Get Oliver Strunk’s elements of style. It’ll recommend some rules of thumb that may well be obvious (e.g., avoid passive voice. Reduce the use of adverbs to a minimum) but overlooked. There have been several editions, and the older ones can even be found online.

(more…)

If you enjoyed this post, make sure you sign up for our mailing list or subscribe to our RSS feed!

Disclaimer: this post may be relevant only for social sciences/psychology people. I found a nice thread on the Judgment and decision making (JDM) mailing list on the need for replications.

Lots of good posts on an interesting discussion. The mainstream view is that we simply don’t run enough replications because they are harder to get published. This leads to studies showing that replications are actually very hard, with only a small percentage (about 40% in the social sciences) being successful.  Robyn Dawes seems to thing that replications are overrated:

the “real” scientists do is to futch around until they get it “right.” The multiple study requirement just adds “first and second and third” studies, thereby wasting space and time.

There are comments on Increasing the Percentage of Papers Replicated, and some nice book recommendations on experimenter bias.

If you enjoyed this post, make sure you sign up for our mailing list or subscribe to our RSS feed!

Have you considered the productivity loss associated to a disastrous computer crash (where you cannot retrieve any of your files)? HDs do die, and it is really time-consuming to get back to a working state.

Anyone who regularly works on more than one computer and needs access to the same set of files will benefit from using a syncing tool. The following scenario is pretty common but not efficient:

You are working on a desktop computer and a laptop at home, as well as on a desktop computer at your office. You routinely copies your Word documents, Excel spreadsheets, PDFs, and other files over to USB flash drives, carry them between your home and workplace, and manually copy every file over to its appropriate directory within My Documents (or whatever home dir you use).

But Sometimes you get things wrong and clobber a newer version of a file with an older one, sometimes you move a file into the wrong place and ends up with duplicates that you must compare by hand, and sometimes you lose a chunk of her valuable work data when one of your computers’ hard drives crashes.

Most people don’t have a backup strategy in place. Everybody has colleagues that have had some kind of disastrous data loss, but somehow they think that their computer is immune to adversity, thieves, and hardware failures.

(more…)

If you enjoyed this post, make sure you sign up for our mailing list or subscribe to our RSS feed!

The Chronicle (newspaper) has a good website with a very active forum. I have been monitoring it for a while, and I can certainly say that there are very informative threads in there. It seems to be a very good place to get privileged hard-to-find information about subtle topics such as what is a good job offer, whether a particular department should be red-flagged because of internal fights, or how to negotiate a start-up package. This forum may well be old news for many, but it was an interesting discovery for me so I’ll just post about it just in case it’s useful for anyone.

They have a section on “balancing work and life”. I wonder how many similar forums centered around a profession have one. Scary.

If you enjoyed this post, make sure you sign up for our mailing list or subscribe to our RSS feed!

The “beyond my mind” blog has a post comparing different academic search engines. The author also describes his search strategy:

The way I search for scientific articles is pretty simple. Say I have a problem to solve that was assigned by some course teachers or my research supervisor. I mark some keywords and Google for them. If I don’t find any relevant information I use combination of those keywords or use alternative keywords adapted from the search results. Once I start getting some keywords that produce relevant results in Google, I pass it to Google Scholar. Sometimes I go to some other subject specific search engines to search using those keywords

I use Web of Science, because it can track cited articles. This is also present in google scholar, but somehow I don’t find it as reliable. I tend to sort by citations, and pay attention to the top few papers only. I guess if most people do like me, there must be a snowball effect going on here, with a ‘rich gets richer’ situation.

Search engines are measured using precision and recall. This is of course relevant, but sometimes more mundane measures are interesting too. The basic unit for productivity evaluating search engines should be something like “time (or clicks) needed to get both the full text and the reference to your hard drive”. Here, small inprovements in usability like going from 21 to 16 clicks to achieve your goal can save quite a lot of time, since we academics use search services so often.

If you enjoyed this post, make sure you sign up for our mailing list or subscribe to our RSS feed!