Agile Standard Development

IPTC rNews - an example of agile standard development

rNews is a new standard for embedding semantic, machine-readable metadata in web documents.[1] This text, however, focuses not on the standard itself. I want to tell you the story of how we got there in just about a year – tremendously fast, in the world of standards.

The term "agile", referring to software development, has become a buzzword in the technology community since its introduction in 2001[2] but I have never before seen it applied to standards development.

According to Wikipedia[3],

Agile software development is [...] based on iterative and incremental development, where requirements and solutions evolve [...]. It promotes adaptive planning, evolutionary development and delivery [...] and encourages rapid and flexible response to change.

Traditionally, work in standards bodies tends to follow the rules of the so-called waterfall model[4] instead. Waterfall methodology promotes thorough up-front research, thorough discussion and feature definition and finally, the design and construction process. Suffice to say, the two models are not compatible with one another: Any sizable project takes years to materialize under the waterfall model.

When the IPTC[5] formed a working group to develop rNews in 2010, we agreed on three guiding principles:

  1. rNews had to be simple to implement
  2. the rNews schema would focus only on publishable metadata (i.e., not contain behind-the-scenes and workflow-related properties)
  3. rNews had to be ready soon

Simplicity. Focus. Speed.

The third requirement was somewhat unusual, compared with much of the previous work the IPTC (or most other standards bodies, for that matter) had done: In standards development, there are rarely deadlines. A standard is ready when it's ready. Obviously, people try to finish their work as soon as they can but if a detail requires further discussion, the necessary time is usually taken. This is because a standard, once approved and published for the world to use, must be reliable. It must allow people and organizations to base their products, processes and projects on without the fear of having to change everything a few months down the road: it's simply an issue of trust.

Simplicity. Focus. Speed. Trust.

It's only apparent in hindsight that in order to achieve all of that, we had to employ many of the methodologies that have come to be known as "agile" but we did so organically, without an upfront decision or discussion.

To keep it simple, we started with our experience in the industry. We made assumptions. We discussed them, agreed and wrote drafts. We actively sought feedback. We incorporated new ideas, threw old ones overboard, disagreed, discussed some more and made compromises.

We wrote more drafts. We tried implementing our own ideas, ran into walls or little stumbling blocks. We asked for advice, received valuable help[6] and went back to the drawing board again.

Our four guiding principles focused us: we could test any new idea or assumption against them. If a given idea did not further one of these principles or, worse, contradicted it, we killed the idea.

Our speed is also owed to a bit of a coincidence: the core authors behind rNews are only three people[7] and we are all based in the same area. One of the drawbacks of that was that it turned out to be a lot of work for each one of us (in addition to our respective day jobs). But the huge benefit was that we could all quickly join calls, meet in person and break ties when we disagreed.

We gained the necessary trust by doing all this very publicly. We talked to people, spoke at meet-ups and conferences, blogged and tweeted about it. We were (and continue to be) approachable and we stand behind the work we've delivered.

Shortly before our release date we were approached by Google, Bing and Yahoo, the sponsors behind schema.org (later to be joined by Yandex). We wanted the search engines to endorse rNews. They wanted us to collaborate on schema.org. Both sides understood that a competition between two standards with very similar goals would be a waste of everyone's energy.

The result were some pragmatic decisions and excellent collaboration on both sides. The IPTC's Board of Directors even approved a change in license terms to accommodate the needs of schema.org, a fairly complex legal procedure for an established industry standards body. (Full Disclosure: I am a member of the aforementioned board.)

I think all involved, inside and outside the IPTC and its member organizations, can be rightly proud of how quickly rNews has come this far and how it has been made available to millions of web publishers, many of whom are implementing it via schema.org without any knowledge of the IPTC and its origins.

Two things...

...I'd like to leave you with. One: if you or your company builds tools and technology for the media or publishing industry or is itself a part of this industry, have a look at the IPTC. They don't bite, they love to work with smart people and they get stuff done. If you have questions about joining, let me know and I'll put you in touch.

The more important one: If you want to define a standard, know your audience and your goals. Define them so you can test against those definitions. Release "betas" and iterate. It doesn't have to take years.

IPTC-branded stress ball

 

Questions? Comments? Leave a comment below or ask me on Twitter or app.net.

   

Footnotes

[1] It's a mouthful, I know. It means that publishers who implement rNews can mark (in a machine-readable way, e.g. for search engines) things like the headline, authors' and editors' names, copyright and usage terms. Better yet, we added powerfully simple ways to mark up the people, organizations, locations and topics that the published text (or photo, video, audio) is about. For more about rNews itself, please check out our extensive documentation at http://rnews.org/   

[2] http://agilemanifesto.org   

[3] http://en.wikipedia.org/wiki/Agile_software_development   

[4] http://en.wikipedia.org/wiki/Waterfall_model   

[5] The International Press Telecommunications Council is a global media industry standards body that was formed in 1965 and has since produced numerous standards that are used in the publishing industry and outside. The IPTC is probably most widely known for its Photo Metadata standards. More information is available at http://iptc.org or on Wikipedia (though slightly outdated).   

[6] A few of the people who deserve recognition in this regard: Michael Steidl (Managing Director of the IPTC), Vincent Baby of Thomson Reuters, Jarred McGinnis of the Press Association (PA), Jean-Pierre Evain of the European Broadcasting Union (EBU), Jayson Lorenzen of Business Wire and also Raphaël Troncy of EURECOM.   

[7] Stuart Myles of the Associated Press (AP), Evan Sandhaus of the New York Times and myself, representing Getty Images.   

Today it's been one year.

This is a personal post on the occasion of the first anniversary of a good friend's death.

Today it's been one year.

One year since a colleague walked into our newsroom with a look of incredulity on her face when I was just getting into the office and showed me a Facebook post on her phone: "Chris Hondros has died."

It turned out to be the start of an hour-long struggle for actual facts. The message was premature at the time, posted by someone on the ground in Misrata (who was either overly eager to break the news or who might have just misinterpreted what he saw or heard – it doesn't really matter anymore). But as the day went on reality caught up. Chris Hondroshad died. He died, together with Tim Hetherington, from injuries they sustained in a mortar attack while they were covering the siege of Misrata in Libya.

I am not just very good at compartmentalizing, I also have a tendency to check things off and move on if it's clear that I can't do anything about a given situation. That has served me very well over the years but I knew that this particular behavioral pattern also put me at risk to quickly forget and just get back to my routine. And I wanted to make sure I didn't.

Actually, I want to make sure I don't forget (present tense). Justin Sullivan had made stickers with the initials "CH" that now grace a lot of our photographers' computers, including my own. My laptop's desktop picture shows one of Chris' many iconic shots, taken just a few days before his death. And since I've named my computers after cities for the past 15 years or so, last year's new MacBook Air is no exception: If you see a machine identifying as MISRATA in your network, that might be mine.

They might seem silly but it's these little things that make me pause and remember. They make me think of Chris' laughter and his mischievous grin. (For those who knew him, I'm sure you understand why I found both very inspiring.) I am happy to say that I've accomplished both: not letting myself get caught up in questions of "what does it mean" but also not forgetting and simply moving on.

Now I'm looking forward and asking myself: Where do I go from here? How can I do my part to ensure that what Chris has done and what he worked and stood for will not stop?

And that's obviously a lot harder to do than to say. For one thing, it's really hard to define what "that" even is. Chris touched individuals' lives. He helped people, directly and indirectly. He told their stories and showed others like you and me what we couldn't see for ourselves, as photojournalists do.

I never was, nor will I ever become, as good a photographer as he was. So that's a non-starter.

As an editor, I offer advice, support and sometimes shape coverage. That's an option and I've been working in that part of our industry for a number of years. (Although today, I hope to empower the editors on my team to do this more than I do it myself.)

As a business person and an editorial technologist, I see myself as an enabler. One of the guys in the background, in the best possible sense. I provide frameworks for others to work within. Lay foundations for others to stand on and improve upon. Make sure the workflows, servers, databases, data models -- and business models! -- are set up to support telling the important stories of our time.

Is that enough? I don't know. Time will tell, I guess.

respond to @agebhard on Twitter

The new toy.

My new The New iPad iPad 3 is on its way. The usualsuspects have already written very eloquently about which kind to get and what it looks and feels like, but let me add my own thoughts to the conversation.

I skipped the iPad 2 because I buy these things with my own money and did not use my original iPad quite as much as my iPhone or my MacBook Air -- so I decided to save a few $$$ for once.

But now is the time to upgrade. If you remember the difference between the screens of the iPhone 3GS and the iPhone 4, you'll understand that when Phil Schiller announced the (or rather: confirmed the long-rumored) Retina display on the new iPad, my decision was made.

I pre-ordered my original iPad back in 2010 for delivery on the first day of availability but because this was a very new class of devices I wanted to be prudent and went with the most basic configuration: 16GB Wi-Fi. I can safely say that this taught me one thing over the last two years: get as much memory as Apple offers (or you can afford). Having to decide how to scale down your music and video library and which apps to install (or not to delete) for each trip sucks. Especially if you travel a lot.

image

image

Consequently, my iPad 3 is the maxed-out version and I went with built-in LTE this time, too. I haven't taken my original iPad with me on a number of occasions because I knew Wi-Fi wouldn't be available (and tethering via iPhone is still a pain). This time, I want to try out how this additional freedom will change my behavior (or not).

Seeing how the newly optimized apps for the Retina display weigh in in terms of size (after all, doubling the resolution means 4x as many pixels), I still think Apple should have offered a 128GB option. I seriously expect that to be the limiting factor for my new toy, despite the fact that I got the largest one available.

So which apps am I going to put on it when it arrives?

My must-haves: Tweetbot, iA Writer, Things, Instapaper, the NY Times and of course The Guardian's Eyewitness.

Additional no-brainers: Agenda, 1Password, iBooks, Soulver, Netflix, Prompt, Snapseed and, to keep up with news from home, tagesschau and the F.A.S.

Anything important I missed?     respond to @agebhard on Twitter.

Something a little different...

Today, instead of hastily finishing one of my own posts in the drafts folder, I want to point you elsewhere. To Greg Campbell's blog and his latest post, Breaking on through. (Greg is an author and many of you know the movie Blood Diamond, which was based on one of his books.) I like these personal accounts and reminders of my friend Chris Hondros, precisely because they're filling in blanks for me as I did not have the chance to know him from way back when...

The Rise of Crowd-Curation?

Here's to 2012. A year that will bring... well, what exactly?

If I knew that, I'd be playing the lottery. But my friend Faruk has an idea:

 

Let's think about that for a minute. Crowd-curation. It really only means that many people (the crowd) contribute to the task of selecting, organizing, and looking after the items in a collection or exhibition. Because that's what curation means, according to the dictionary. Leave aside, for now, that most people's interest – or attention span – will not actually extend to "organizing" and "looking after" any items. But the crowd will happily come together in selecting things. Sounds like it could be fun, right? And we already do this: When we hit that +1 or Like button or the little star to favorite (is that even a verb?) each others' pictures, videos, sounds or tweets then we are actively participating in crowd-curation by expressing to others what we thought was noteworthy or even: good.

More fundamentally, by sharing a link to content made available by someone else we're curating the entire web: Our followers are pointed to something we think they should pay attention to.

And don't we all enjoy funny dog pictures? So, yeah. Fun, right?

Well, not necessarily. What's one crowd's fun can be another one's "holy crap" moment. Professional curators and editors will not be happy, once they realize what Faruk's tweet really means. They might even be scared shitless — because this feels like it might endanger their livelihood. Not today and likely not this year. And as a manager of a crack team of professional journalists, I know that The Crowd will not be able to rival what "my" photo editors do anytime soon. But we also can't turn a blind eye to simple facts of life. Often, good enough is just that: good enough. And if recent history has taught us anything, it is that changes in technology and the associated behavior patterns have impacted every profession that they touched. Manufacturing, photojournalism and everything in between has changed when technology enabled new ways of production or gave rise to new consumption patterns. Amateur photographers suddenly had technology in their hands that replaced decades of a professional photographer's experience. Travelers suddenly booked their trips without the help of professional travel agents on websites. (But boy, do we miss them already!) Let's not kid ourselves: There is no reason to believe editors and curators will be an exception in the long term — unless Faruk is wrong.

(But he's right.)

Obviously, there are downsides to crowd-curation. While it has all the attributes of a good buzzword that might get your startup funded by venture capitalists, it has its limits for a society: crowds prefer what they already like and that doesn't necessarily give rise to high quality content. (If you've ever tried to use Twitter's trending topics you know what I mean.) To know if I like something I must first know that it exists. Consequently crowd-curation doesn't necessarily ease the dissemination of new and unusual content. There is a good chance that sticking to one's interests and surrounding oneself with people that share these interests will result in an echo-chamber that doesn't leave room for growth. I'm sure we've all seen examples of this at one point or another.

And semantics matter: curation is probably a misleading term for what we're discussing here because curation, to most people, implies authoritative selection of the best from a known set of items. What we're talking about here is making decisions about individual items: do I like this picture or not? Do I share that link or not? Those singular decisions about singular items then combine to give rise to what's most liked and most shared on the web, giving an illusion of crowd-curation.

Not to speak of the business interests who will want in on the game...

 

But those downsides, provided you even agree and see them as downsides, will neither keep crowd-curation from happening nor from becoming an integral part of modern life.

Of course businesses will try to use crowd-curation to their advantage. We'll see more of what's called viral marketing today and curation system providers will find ways to charge for sponsored upranking. Ultimately, it is too promising to rely on an unpaid crowd of consumers to exactly say what they like (== what they might be willing to spend their money on) to not be exploited.

So what's my point, you ask?

It is to help me focus my own thoughts and to maybe encourage you to share your own. What application of crowd-curation are you looking forward to and what aspects not so much? Maybe I'm way off? Do you have a good idea for a better term? Other thoughts? Objections? Ideas? Leave a comment below or