Michal Migurski's notebook, listening post, and soapbox. Subscribe to this blog. Check out the rest of my site as well.

Mar 30, 2009 3:26pm

twitter seismograph

There was an earthquake here, about an hour ago. Here is the USGS report map:

(magnitude 4.3, 11 miles out of Morgan Hill)

Here's my homegrown seismometer, a record of Twitter frequency mentioning Oakland:

Most of those messages are twitter people saying things along the lines of "felt it in Oakland!".

I've been recording tweets with the thought that they'd be useful for Crimespotting, experimenting with a bit of RRDtool for tracking time-series data, and playing with Mike Bostock's excellent new Protovis tool for client-side graph rendering in Javascript.

Mar 26, 2009 10:22pm

stamen maps cloudmade

Did I mention that we worked with with CloudMade last month, producing three new visual styles for their OSM-derived world maps?

Geraldine did, and CloudMade just announced that our work has been folded into the Style Editor, where you can start with the basics and modify colors to suit your desires.

We used Cascadenik to rapidly generate three new looks that we think are pretty spiff: Pale Dawn, Midnight Commander, and Fresh. Here are some ludicrously large renderings of two of them.

Mar 20, 2009 4:36am

here comes cyberwar!

I have a greenfieldian weakness for papers like Cyberwar Is Coming, published by the RAND Corporation in 1997. They're like GI Joe for grownups, and this one in particular resonated with parallel writings on the impending total dominance of the internet for basic communication.

The authors, John Arquilla and David Ronfeldt, have great admiration for the Mongol Hordes:

...our vision is inspired more by the example of the Mongols of the 13th Century. Their "hordes" were almost always outnumbered by their opponents. Yet they conquered, and held for over a century, the largest continental empire ever seen. The key to Mongol success was their absolute dominance of battlefield information. They struck when and where they deemed appropriate; and their "Arrow Riders" kept field commanders, often separated by hundreds of miles, in daily communication.

It's about information and lines of communication: "the Mongol way of warfare ... may be the closest that anyone has come to waging pure cyberwar.... Use of this example also reinforces the point that cyberwar does not depend on high technology, but rather on how one thinks about conflict and strategic interaction." Arquilla and Ronfeldt show how the Mongols ignored their enemies' conquer-and-hold techniques in favor of a kind of melting through enemy lines, being everywhere at once, sowing confusion and disarray. The "cyber-" prefix is derived from cybernetics and control theory, and suggests war "about knowledge - about who knows what, when, where, and why."

The parallels to the messy world of internet communications are immediately obvious, especially in terms of many-to-many networks:

Organizationally, the Mongols emphasized decentralized command in the field, unlike their foes who were generally required to wait for orders from their capitals. Yet by developing a communication system that kept their leadership apprised at all times, the Mongols enjoyed topsight as well as decentralization. The Khan "advanced his armies on a wide front, controlling them with a highly developed system of communication" - that was the secret of his success (Chambers 1985:43).

Having spoken to a small group of grad students at the UC Berkeley J-School this afternoon, I'm immediately reminded of this month's kerfuffle over the future of journalism. In one corner you've got Clay Shirky arguing that "old stuff gets broken faster than the new stuff is put in its place", while Charlie Gibson blames young people and the internet and hopes for One Big Website that could replace the content (and revenue) of the New York Times. Gibson here is like some unfortunate defender of a city under siege by foreigners with horses and bows, unable to understand how they reached so far so fast. What's interesting is that the invaders aren't even gunning for the citadel, they're just charging through. Individuals publishing online are cutting to the source of raw information, doing their own legwork and analysis, overrunning the central editorial expertise of the traditional newsroom with superior speed, maneuverability, and general unconcern with the consequences.

In strategic terms, the Mongols aimed first to disrupt an enemy's communications, then to strike at his heart. Unlike Clausewitz, they put little store in the need to destroy enemy forces before advancing. Also, Mongol campaigns were in no way "linear." They struck where they wished, when circumstances were deemed favorable. That their Christian and Muslim foes seldom emulated the Mongols' organizational and communication techniques is to their great discredit.

There is very little new under the sun, and the collision between old top-down power structures and young bottom-up ones seems like a cycle that will continue for some time. In particular, I'm unpersuaded by arguments such as Chris Messina's doe-eyed post on transparency and "generation open":

If we are Generation Open, then we are the optimistic generation. Ours only comes around every several generations with the resurgence of pure human spirit coupled with the resplendent realization of intent.

Chris writes about the raging boner he's developed for whatever it is that Facebook has going on the back burner with API's or something, but there's very little open or decentralized about the service. It is, ultimately, a giant directory that wants to be the middleman for all your basic communications with the people you care about, just like the "megacorporations" he blames for dropping cell calls on 9/11. What will happen now that they've seemingly decided to stop letting 80% of their messages fall to the floor?

Decentralization is not permanent change, and it's not ultimately a steady state: things get crystallized into increasingly-rigid structures, or they are allowed to drift apart. Decentralization is a tactic enabled by material detachment, a way to quickly conquer Europe or improve access to information. As the dust settles, new superstructures are built in an effort to consolidate gains and improve efficiency.

We're blessed to be experiencing a time of Big Tactics, when rapid motion and creative destruction set the tone and mobile burger treasure hunt is the order of the day. We have a president right now who just circumvented government structure entirely and made a Happy Nowruz video directly for the people of Iran, how crazy is that?

Mar 11, 2009 2:59am

maps from scratch

Yesterday, Shawn and I led a three hour E-Tech workshop called Maps From Scratch. Our goal was to step attendees through the creation of beautiful online cartography, from vector data to rendered images. We introduced a variety of tools and concepts, like shapefiles, spatial databases, Mapnik, and TileCache. One of the things that made this tutorial especially interesting for us was our use of Amazon's EC2 service, the "Elastic Compute Cloud" that provides billed-by-the-hour virtual servers with speedy internet connections and a wide variety of operating system and configuration options. Each participant received a login to a freshly-made EC2 instance (a single server) with code and lesson data already in-place. We walked through the five stages of the tutorial with the group coding along and making their own maps, starting from incomplete initial files and progressing through added layers of complexity.

Probably the biggest hassle with open source geospatial software is getting the full stack installed and set up, so we've gone ahead and made the AMI (Amazon Machine Image, a template for a virtual server) available publicly for anyone to use, along with notes on the process we used to create it. The AMI number is ami-df22c5b6, and you can find additional information on the (presently) bare bones website, mapsfromscratch.com.

October 2017
Su M Tu W Th F Sa

Recent Entries

  1. planscore: a project to score gerrymandered district plans
  2. blog all dog-eared pages: human transit
  3. the levity of serverlessness
  4. three open data projects: openstreetmap, openaddresses, and who’s on first
  5. building up redistricting data for North Carolina
  6. district plans by the hundredweight
  7. baby steps towards measuring the efficiency gap
  8. things I’ve recently learned about legislative redistricting
  9. oh no
  10. landsat satellite imagery is easy to use
  11. openstreetmap: robots, crisis, and craft mappers
  12. quoted in the news
  13. dockering address data
  14. blog all dog-eared pages: the best and the brightest
  15. five-minute geocoder for openaddresses
  16. notes on debian packaging for ubuntu
  17. guyana trip report
  18. openaddresses population comparison
  19. blog all oft-played tracks VII
  20. week 1,984: back to the map