Code_Swarm - An Experiment in Organic Software Visualization

June 25th, 2008

I’m a fan of Open Source technology as well as interesting visualizations… so when I came across this experiment in information visualization on the creation of Open Source applications, I was intrigued.

This visualization, called code_swarm, shows the history of commits (when a developer makes changes to the code or documents) in a software project.

open source info visualization

Organic information visualization, coined by Ben Fry, is a different approach to information visualization. It eschews traditional data confinement in space and lets the elements play together in free-form and unpredictable ways.

Have look at the video below, which shows Python’s project evolution.


code_swarm - Python from Michael Ogawa on Vimeo.

More videos can be found here.

Popularity: 17% [?]

Data Integrity - What Does It Really Mean? Why Is It Important?

June 9th, 2008

Excuse me for going a little off topic but Data Integrity is essential to even the most rudimentary Information Visualizations.

No visualization is worth a thing if it leads you to the wrong conclusion.

Often, as new and interesting terms arise in the IT industry (buzz words), they are carelessly tossed around in the attempts to impress (and often confuse) the intended audience.

buzz.word n. — A usually important-sounding word or phrase used primarily to impress laypersons.

More often than not, I notice people have varying perceptions of what such terms actually mean, causing a barrier to clear communication.

Here’s what I imagine people thinking as they are subjected to jargon/buzzwords:

“What does your flashy new term really mean?”


“Should I be impressed that it’s a word or term I’ve never heard before?”


“I’d much rather you explained it in a way that actually meant something to me.”

What does Data Integrity really mean and why is it an important term for people to understand?

As the need to derive meaningful information from large sets of data becomes a higher priority both in the government and private sector, Data Integrity is what gives users the assurance that the information they see is trustworthy.

Many organizations build and rely on a Data Warehouse,

“…the main repository of an organization’s historical data, its corporate memory. It contains the raw material for management’s decision support system”

I believe I’ve identified a few definitions that hopefully embody what Data integrity is meant to be:

Wikipedia:

Data Integrity is a term that can mean ensuring data is “whole” or complete…

Put simply, data integrity is the assurance that data is consistent, correct, and accessible.

Data Integrity Triangle

In relation to data warehousing projects, where data integrity efforts have significant and widespread impact:

The author of Ensuring Data Integrity offers:

…Data Integrity is defined as information that adheres to a strict standard of value and completeness. That is, the data is both accurate and the entire population of relevant data is contained within the data warehouse.

The credibility of the data warehouse solely rests with the integrity of its data.

So, Data Integrity is clearly important and may in fact be a term that incorporates a number of niche terms relating to the proper management of data.


So, now it seems there are so many more questions…

  • How does one ensure data integrity?
  • How can the integrity of data be compromised?
  • What activities go in to providing data integrity assurance?
  • How is data integrty success/failure reported?
  • What’s the worst that could happen if a little of my data lacks integrity?

I hope I have enough time to try and figure all that out…

Popularity: 37% [?]

Cool Infographic Videos: Nextel

May 30th, 2008

OK, back to information visualization. I’ve been away and/or very busy for a while so I am relying on some of my favorite blogs to find some interesting stuff while I get back into the swing of things.

I love infographics, and www.coolinfographics.com is a favorite blog of mine… and it’s also where I discovered some new infographic videos for Nextel done by Superfad.com.

How did Sprint establish operations, restore communications and coordinate supplies in less than 72 hours after Hurricane Katrina Hit?

How do emergency responders use Nextel Direct Connect to find you before a bear does?

Popularity: 49% [?]

Back from Vacation

May 30th, 2008

Well, back from my long anticipated vacation and I can’t tell you how much Washington DC does not, in any way whatsoever, resemble Costa Rica.

Just as a quick example, take a look at the sunset while we camped on a black sand beach. Amazing!

sunset in costa rica

If you haven’t been, i highly suggest it.

Popularity: 47% [?]

Who has the Oil? Map of Country usage and production

April 30th, 2008

I’m sure I’ve posted this map before… but after spending nearly $70 on a tank of regular gas this afternoon (i drive a 4-door sedan) I couldn’t help but think back to this image and how perilous it seems.

who-has-the-oil-map.jpg

The United States consumes more than 20,000,000 barrels of oil every day (more than 3 times any other country) but has less than 2% of the worlds remaining oil.

While energy efficient cars seem to be the no-brainer quick fix… I wonder if Americans are truly willing to sacrifice the feeling of satisfaction that many get when driving a behemoth of a car. (That’s why people drive Hummers, right? It’s not for the trunk space)

Hummer Cartoon

Popularity: 76% [?]

Mapping the Rhythm and Flow of Literary Works

April 24th, 2008

I found this at Cool Infographics.

Found on notcot.com, On The Map is a cool project by Stefanie Posavec that maps the rhythm and flow of literary works into some stunning visual posters.

Literary Organisms

Breaking a story down into chapters, paragraphs, sentences and finally individual words. Then color coded to capture the topics as they reappear throughout the story. The level of detail is really impressive.

Sentence Drawings

Rhythm Textures

Popularity: 81% [?]

Smashing Magazine Inspiration: Data Visualization and Infographics

April 21st, 2008

Smashing Magazine is well designed… and so is their post on popular Infographics and Data Visualization.

This article presents some spectacular data visualizations and infographics which manage to combine a strong visual appeal with the effective presentation of information.

I’ve taken the liberty of sharing some examples… check out the full article after the jump.

DIZZIA, Gregory M.
This is the documentation of every intimate relationship Gregory Dizzia has ever had. The data spans 23 years.

Dizzia

The main goal of data visualization is its ability to visualize data, communicating information clearly and effectivelty. It doesn’t mean that data visualization needs to look boring to be functional or extremely sophisticated to look beautiful.

Virtual Water
Simple, clean, elegant and effective. A double-sided poster visualizing the water footprint of products and nations.

Virtual water

Mapping the Blogosphere
This is what the blogosphere looks like

smashing-blogosphere.jpg

Megan Jaegerman
A review of Megan Jaegerman’s work by Edward Tufte. Notice how clean and legible the infographics are.

Megan Jaegerman

Popularity: 92% [?]

America’s Most Sinful Cities - Interactive Map

April 16th, 2008

I found this article at Flowing Data.

Forbes ranked and mapped cities based on the seven deadly sins. (Lust, Gluttony, Avarice, Sloth, Wrath, Envy, and Pride).

DC avarice

While the interactive map isn’t all that complex, it’s an interesting and enjoyable way to discover what Forbes believes to be America’s most sinful cities.

lust-dc.jpg

“For each sin we stretched our imagination to find a workable proxy–murder rates for wrath, per capita billionaires for avarice–then culled the available data sources to rank the cities.”

I’ve lived in and around Washington DC all my life…. maybe it’s the allure of a sinful city?

Washington DC Ranks:

  • Avarice - #9
    • Greed isn’t confined to money… Power?
  • Lust - #6
    • I can only conclude that I must not be hanging out with the right crowd
  • Wrath - #7
    • Hmmm… well, we do have SouthEast DC

wraith-dc.jpg

So where’s Vegas? Las Vegas only ranks in the top ten in one category, Sloth (#3).

sloth-vegas.jpg

Popularity: 92% [?]

oSkope - Highly Intuitive Visual Search

April 8th, 2008

Sure, other search engines provide the ability to search for images and more, but it’s really how you interact with that information that’s important.

oSkope is a search assistant with a highly intuitive visual interface. oSkope lets you browse quickly through a large number of images and preview information with minimal paging.

oskope-visual-search.jpg

For starters, I love the drag and drop feature on my search results. The feature mimics many of the coolest gadgets on the market today like the iPhone and the Microsoft Surface.

How it works:

  1. Select favorite online service: Amazon, Ebay, Flickr, YouTube etc.
  2. Drill down into subcategories via pull down menu or search function
  3. Results appear as thumbnails in display area. (Thumbnails can be dragged and dropped to rearrange favorite items)
  4. Hovering over image will display preview with link to original page
  5. Registered users have the ability to drag favorite item into “My Folder” for future viewing.


You can switch between display modes, or “views”. Currently the following views are offered: grid, stack, pile, list, and graph.

While the various views add value by loading instantly and providing new ways of approaching your search results, the Graph View is the real winner among the group.

oskope-graph-view.jpg

The graph view is special because it changes depending on the service you select. Your results are plotted against relevant axes. For example…

  • Amazon.com (X = Sales Rank, Y = Price)
  • Ebay.com (X = Time Left in Auction, Y = Price)
  • Youtube.com (X = Date, Y = Ranking)

Of all the various visualized search engines I’ve come across, oSkope is definitely a favorite because of it’s unique and interesting way of letting me sift through my results.

Popularity: 98% [?]

50 Essential Knowledge Management Sites and Blogs

April 4th, 2008

.

Kudos to Lucas McDonell for assembling an excellent list of 50 Knowledge Management Sites. Great resource. Check out the details at his site

Popularity: 100% [?]