The State of Data Portability in Social Media, Part I – A Closer Look at Facebook

View the original post on dataportability.org

[The following is not a commentary on data portability policies at Facebook --- that will be a follow-up to this series. Instead, this article attempts to document the current state of data portability within social media, and in this case, Facebook in particular]

Every day, Facebook consumes billions of snippets of people’s lives in the form of freely-provided pictures, comments, messages, and more and stores them away in server facilities scattered throughout the world. This information is added to the tons of other information they already have and then used to render details of our lives upon request. But beyond the Facebook website, how can a user interact directly with their information?

Facebook’s Personal Archive

Accessing your Facebook information is as simple as visiting your Facebook page, or that of your friends. This structured format is constantly being tweaked to provide what Facebook believes is the best way for you to interact with all of this information. But they also provide a mechanism for you to take your data “offline” through the downloading of a “personal archive”, as in:

Getting to this result starts easily enough, simply access your account settings from your Facebook page and select “Download a copy of your Facebook data” at the bottom of the GENERAL ACCOUNT SETTINGS tab.

After a bit of security validation, the process begins. Facebook starts gathering your information into your personal archive and emails you when complete. Not all of your information is provided, however, particularly things that involve activity with others. Specific information includes:

Now, I believe that I am a moderate to light-weight Facebook user. I do not use it every day, although I do have several hundred “friends” and my twitter feed auto-posts to Facebook. Still, it took almost a full hour to gather my information and package it up with neatly organized directories into a 44MB zip file ready for me to download.

And here’s the content of the zip file representing my personal archive from Facebook:

Now that I have my data on my own computer, I can browse through it without having to be connected to the internet. I have successfully downloaded a copy of my data Facebook allows me to access offline. There were some issues browsing the data, the biggest being no “pagination” for the data, hence when I tried to view all my messages the browser locked up trying to render so much information.

From a pure data portability perspective, this process is more of a “backup” of data than true data portability. The information provided is pre-formatted into html documents that make it easy to interact with IN THE FORMAT CHOSEN BY FACEBOOK, however much of the underlying data is unavailable to non-programmers.

I had hoped to see additional formats to the archive, or even just one, other than formatted HTML. JSON would have been my first choice, and, in fact, there was a time when Facebook did provide this option, but alas no more.

Facebook’s Graph API

Programmers have considerably more options through Facebook’s extensive SOCIAL GRAPH API and related tools and resources, but this is not for the average user. Most applications today that integrate with Facebook are doing so in one form or another through the API interface (or one of its related components or plugins).

Interaction with graph data is extensive. From the Facebook’s Developer pages:

“The Graph API presents a simple, consistent view of the Facebook social graph, uniformly representing objects in the graph (e.g., people, photos, events, and pages) and the connections between them (e.g., friend relationships, shared content, and photo tags).”

Facebook has also provided public access to the GRAPH API through the use of its RESTful interface. This makes it extremely easy to gather specific information from the social graph simply by referencing a web address, as in:

3rd Party Alternatives to Facebook’s Personal Archive

Facebook itself is not the only option for users interested in extracting their information. One of the most interesting alternatives is a site called www.givememydata.com (with an accompanying Facebook App), built by assistant professor of art Owen Mundy of Florida State University. It essentially provides a user interface to many of the programmatic aspects of the Facebook Graph API.

 

A variety of other options exist that can help users access and interact with their information, but ultimately Facebook has the biggest opportunity, as well as responsibility, to see these initiatives through.

Coming up next: The State of Data Portability in Social Media, Part II – A Closer Look at Google.

-- Steve Repetti
    www.radwebtech.com

Google continues it's drive towards Data Portability...

Larry Dignan over at ZDNET wrote a post today entitled “Google ramps up its data portability as a weapon push” which discusses the further roll-out of Google’s Data Portability initiatives. Good stuff to be sure, and I hope it doesn’t end there.

My comment:

“Nobody seems to care about Data Portability until they need it and are denied access. Companies support Data Portability when it is good for them and it doesn’t conflict with their larger agendas, otherwise it is mostly ignored. And, of course, all of this changes on a moment’s notice and subject to the prevailing wind.

The real power of true Data Portability lies in its ability to extend and enhance not only existing services like Google and Facebook, but to facilitate entire ecosystems that reward innovation, value-add, and usefulness while chastising the walled gardens and private silos – or at the very least keeping them in their place.”

--Steve Repetti
Chairman, DataPortability.org
www.radwebtech.com

Data Portability Wars : Google and Facebook vs. YOU

Well, here we go again.

The big companies love to embrace data portability and the freedom it provides its users, not to mention the press and good will that comes with it, as long as it doesn’t conflict with their corporate agenda.

Let’s call it what it is: Facebook and Google both support “convenient” data portability --- at all times convenient for them, *sometimes* convenient for you.

Google and Facebook have both flirted with data portability and it was generally taken as a good sign when both hired leading open source/data portability advocates (Chris Messina and David Recordon respectively). Facebook’s APIs and social graph integration, as well as Google’s Takeout initiative, have been shining examples of the net result of this effort.

Still, despite these advances, both companies continue to “play” with your data – to your detriment. Back in February, Google removed an existing feature from its Android mobile phone operating system specifically to make it more difficult for users to integrate their Facebook contacts (Nexus S losing Facebook contacts sync as Google tightens data policy).

The latest salvo in this escalating war occurred while the US celebrated its Independence day holiday weekend: Facebook disabled a critical feature used to export your friends data (Facebook blocks Google Chrome extension for exporting friends). This appears to be a direct response to Google’s recent moves further into social networking: Google+ (Facebook blocks friend export tool in Google+ snub ).

The reality is that we gave both companies the right to monkey with our data. We accepted their terms of service when we joined their services and we continually agree when they make changes – for better or worse. And, while a few have left in protest, it is not practical to expect much more.

Let’s call it what it is: Facebook and Google both support “convenient” data portability --- at all times convenient for them, *sometimes* convenient for you. And maybe that’s ok. After all, they are commercial enterprises answerable to boards and shareholders and subject to their leadership within.

I get it. Information is an asset, and why would anyone fiscally responsible intentionally dilute or give away an asset?

And therein is the conflict. Us versus them, my data versus their monetization of it.

I hereby challenge Google, Facebook, and all other interested parties to sit down at a DATA PORTABILITY SUMMIT and figure it out together.

This is complicated stuff. If Google and Facebook truly want to be the global purveyors of information that they purport to be, they’ll figure it out – or leave opportunity for the next company to come along and get it right. But the first thing they need to understand is that they cannot do it alone. When crafting global policy regarding user’s data they must include the user, otherwise they are simply more walled-gardens of varying heights.

So, before this thing spirals any further, let’s talk about it.

As Chairman of the International non-profit Data Portability organization, I hereby challenge Google, Facebook, and all other interested parties to sit down at a DATA PORTABILITY SUMMIT and figure it out together. Name the place, name the time – or your users will. Now is your chance to truly show leadership on a global scale. But know this: that coveted asset of information you possess exists solely because of your users. It’s ok to be capitalistic, and its good not to be evil, but it’s time to make data portability convenient for us all.

Interested in the DATA PORTABILITY SUMMIT? Let me know: steve@radwebtech.com

Steve Repetti
Chairman, DataPortability.org

READ THIS ON THE DATA PORTABILITY BLOG: http://blog.dataportability.org

Google Unleashes New Data Portability Initiative: Google Takeout

Google today unveiled a new service that provides advanced Data Portability across its diverse platform. Google Takeout (http://www.google.com/takeout) makes it easy to extract your data from a variety of Google Services including: Buzz, Contact and Circles, Picasa Web Albums, and Profile. The information is provided in a variety of formats, including vCard and JSON (JavaScript Object Notation), and can be quickly downloaded onto your local computer.





In many ways this is not unlike the Data Portability initiatives over at Facebook, and it is certainly a welcome addition to the Google universe. And now that Google is moving more into the social networking space with its just announced Google+ project (http://plus.google.com), the value of Google’s Data Portability efforts to its end-users will likely substantially increase.

RockMelt Builds on Facebook’s Data Portability

An innovative new product has entered the scene that will likely test the resolve of Facebook and others as it relates to data portability. RockMelt (www.rockmelt.com) is a customized implementation of the open source (Google) Chrome browser that tightly integrates social media while maintaining the comfort (and speed) of the Chrome browsing environment. It is so tight in fact that Facebook is likely trying to figure out what to do with this revolutionary – and potentially dangerous (to them) – new thing. You see, RockMelt gives you much of the experience of being inside of Facebook without actually being there – including no Facebook ads — all thanks to Facebook’s data portability capabilities. In many cases the RockMelt browser does Facebook BETTER than Facebook.



Of course if Facebook looks at all of this with an open mind, they will realize that RockMelt has “officially” made Facebook the center of the social communications universe – and FB’s data portability initiatives are powering an increasingly expanding wave (sorry Google, no pun intended) that solidifies that position. The question remains whether Facebook will embrace this direction and take it even further or feel threatened and seek to crush that which it does not control. I for one wouldn’t be surprised if the RockMelt browser became the Facebook browser…

Regardless of the result, it is the innovative use of data portability that sparked this particular seed of innovation.

Facebook Data Portability Takes First Step into the Light

Today’s announcement from Facebook represents the most important statement from them to-date regarding Data Portability. But to be clear, it is by no means the ultimate solution we all seek. Still, it represents major movement in the right direction.

First, you literally can draw a line on the calendar and say “prior to this date it was virtually impossible to get meaningful information out of Facebook without being a programmer” – that has now changed. Is it everything we could want? No, but it’s a pretty good start. It’s not so much what you can do with the information today, rather that it is available and will absolutely fuel innovation tomorrow. Sure, other services will use this information, but Facebook is showing leadership as well as responding to the will of its user base – to the benefit of us all.

Secondly, and more importantly in my mind, this announcement shows the elevation in importance of openness and standardization. More than a few of us scratched our heads when open-source guru David Recordon joined the walled-garden giant not so long ago. So it is with great excitement we learned today that David’s efforts (along with all of his cohorts and team members) have succeeded from the inside where so many others have failed from the outside.

From a pure data portability perspective, there is still much more that Facebook can do, but I applaud their direction and effort. This is way more than PR, this is policy that has grown from within and is now escaping into the light. Today’s announcement is the beginning; the Sleeper is waking; and openness lives on with more on the way.

Kudos.

–Steve Repetti
Vice-chair, DataPortability.org

Facebook Embraces Data Portability – Again

Today, Mark Zuckerberg, CEO of Facebook, made his strongest endorsements of Data Portability to date. Speaking from the company’s Palo Alto offices earlier today he stated:

“There is this concept of data portability that we’re trying to enable. We believe that people own their information and not only should they have control over it, but they should be able to take it to other services.”

This is a bold pronouncement from a company that has all too often been perceived as being more closed than open when it comes to data policies.

Of course the devil is in the details, particularly in understanding better what he means when he says “this concept of data portability that we’re trying to enable” – hopefully the “concept” is the same one most other folks understand to be regarding data portability.

As for the rest of his statement, it is a significant milestone for him to say “people own their information” and that they “should be able to take it to other services. If this holds true, then Facebook may be on the verge of becoming the largest and most influential supporter of data portability – to the significant benefit of all.

Still, Facebook has been here before – having initially joined the non-profit Data Portability organization and then largely remaining on the sidelines.

Hopefully, this all comes to pass and Facebook becomes the shining example of how a large company can balance direction and profitability with open data policies. If not, Mark’s words will likely become a rallying point that will surely stick in his side.

But, for now we’ll take him at his word, literally, and hope that the corner has turned. If this is in fact the case, then one of the best things that Mark and Facebook could do is to enact an official Portability Policy – just like those suggested by the recently released PortabilityPolicy.org from the Data Portability organization.

Read more: http://social.venturebeat.com/2010/05/26/zuckerberg-motivations/

POWER.COM Serves FACEBOOK a PR HEADACHE, Thrusts DATA PORTABILITY into LEGAL Spotlight

Yesterday, social aggregator POWER.COM filed a countersuit against Facebook that raises some thorny issues for Facebook and adds some interesting defenses for the case of data portability and personal data ownership. It is not yet clear from reading the pleadings whether either party will win in this escalating case (there are some key issues and concepts on both sides that a Court will have to wade through), but it is clear the issue of Data Portability comes center stage.

Jason Kincaid over at TechCrunch released an interesting article on the subject, “Power.com Countersues Facebook over Data Portability,” along with a copy of the counter-suite.

In their opening salvo, Power steps up to the soap box and discusses “a borderless Internet where users have the right to own and control their own data” and goes on to present their recently adopted “Internet User Bill of Rights:”



This is great stuff for users and data portability, and in many ways mirrors much of our work over at the Data Portability Project (http://www.dataportability.org), however it has little to do with what Facebook is doing in the context of their site or their lawsuit. It does, however, place Facebook in a position of having to answer why it does not agree with these principals.

Thus far, Facebook has tread cautiously as it relates to user data and rights therein. They do not wish to give away the store or proprietary and competitive advantage, nor do they wish to (further) incur the wrath of its users by inflicting too many restrictions. Many of us hoped that a number of Facebook’s recent initiatives signaled their willingness to explore a leadership role in this highly important area. Unfortunately, the pleadings conflict with this hoped for direction.

From Facebook’s perspective, Power.com violated Facebook’s stated terms and conditions; the contract that establishes the relationship between the parties for the use of the site. Every Facebook user has agreed to this (or they wouldn’t be using the site), but, like virtually every other “terms and conditions” document, it is overly broad, highly protective, filled with legalese, and generally ignored by most actual users. It is merely the lack of enforcement by the provider (in this case Facebook) that keeps these things out of court more often. (The standardization and simplification of this topic is also the subject of much work over at Data Portability and other advocacy organizations).

Power.com counters by saying they are doing nothing that Facebook isn’t already doing themselves, and, besides, theirs (they believe) is the right way anyway. It is clear that Facebook does not agree with this position but now is in the difficult position of explaining why many of the good points that Power.com raises are not valid within Facebook.

Still, Facebook is a privately held company and they get to decide what is allowed or not. No court, other than the one of public opinion, can force them to do what they do not want to do – unless the legal line is crossed.

And while I do not believe that Power.com has a leg to stand on when trying to win based on how much “screen scraping” of data is allowed (Facebook’s terms and conditions say none), they have raised some interesting issues that could inspire both the court of opinion and the hollowed halls of justice.

At the very least, Facebook is highly conflicted. It does not own the copyrights associated with all of the information available on its site; it does use some of the very techniques with 3rd-party sites that it accuses Power.com of using against Facebook; it has moved in the direction of providing greater access to its data; and it is party to litigation that potentially represents a PR quagmire.

More significantly for Facebook, Power.com raises the issues of “Restraint of Trade” and “Restraint on Competition” regarding data portability which both lead to the dreaded “M” word: MONOPOLY. Specifically:

“Facebook’s conduct restricting users’ ability to access their own data constitutes an unlawful restraint of trade under Section I of the Sherman Act.”

“Facebook’s conduct constitutes monopolization (or attempted monopolization, ed.) of the market for social networking website services in violation of Section 2 of the Sherman Act.”

With all of the issues at hand, I predict that there will be chest banging and posturing by both sides, some “interesting” press conferences, followed by a negotiated settlement that washes the issue aside and lets both parties (partially) save face. Regardless, Facebook will likely take a PR “black eye” over this.

But I submit there is another, better, solution: Facebook should not only continue its current efforts of data portability and accessibility, but become the leading player on how to do it right! Users would benefit, Facebook would be crowned a friend to all proponents of Data Portability, and the lawyers would find something else to do! In absence of such, Facebook risks becoming the view in the rear view mirror for the company that actually does get it right.

IMHO.

Scrapplet integrates Facebook's new Comment Widget

Scrapplet releases support for Facebook’s new comments object. Just select it from the Scrapplet object gallery (objects -> object gallery -> Comment- Facebook) and click or drag it onto your page. Seamlessly integrate with Facebook’s messaging system via Scrapplet integration with Facebook connect.



Now that Facebook’s comment widget is an integrated object within Scrapplet, it automatically inherits all of Scrapplet’s object properties, including appearance options, extended event handling, and even OpenAjax hub interaction.

Facebook does about-face, shows true colors – and we like the aura!?

Having previously put its foot down regarding the proprietary nature of its instant messaging (see: Facebook bullies IM-provider Meebo), Facebook has demonstrated its desire to open its world to the masses by now embracing Meebo and their support of instant messaging via Facebook Connect.

Jason Kincaid of TechCrunch points out that this has been a contentious relationship with anyone’s bet as to the outcome. Yet here we are barely 30 days after a public smack down and Facebook is touting the very company they were previously dissing. So, what’s really going one here?

Meebo tried to provide a valued service that real-world customers craved. Facebook pointed out that such effort violated its terms of service and wielded the big hand of the giant (meaning, if we don’t provide it – you can’t). Meebo said, “yes --- but can’t we all just get along?” And then…clarity set in. Facebook affirmed that they were in fact the giant, but realized that the giant is not necessarily the enemy of the populous; and that life shared was life to be enjoyed – by ALL.

More importantly, the giant has revealed that it can dance to popular music and stay in step with the desire of the masses. This is an important precedent (one that Microsoft and Yahoo should pay more attention too), and one that we can only hope is an indication of things to come. Data portability is the enabler that allows these things to happen, and acceptance of such need is the vehicle that drives evolution, revolution, and enlightenment of the giant.

To me, Facebook has always been that elusive idea that always avoided the mainstream, that was happy living in the fringes of my vision, and that survived by not intruding on my day to day. But, particularly recently, Facebook has elevated itself to a position of leadership – of showing the way that, while not perfect, nevertheless demonstrates movement in the right direction. To quote Herbert, “The Sleeper has Awoken” -- and we all do really wish that it is everything we hope it can be!

But is this really enough, or is it just baby-steps in disguise of innovation? Opening up to another service is one thing, but embracing open standards and providing integration leadership is another thing altogether. This announcement lacks the embracement of existing and open methodologies in favor of proprietary solutions provided at the direction and discretion of the giant.

Even so, is this a step in the right direction? Absolutely. Is it enough? Not a chance. On the one hand users should smack Facebook for ignoring the entrenched standards that form the pillars of openness, on the other, they should applaud them (and encourage them) for finally moving in the right direction. But we should ALL remind Facebook that this is a work in progress and to not stray from the path. We encourage the effort and look forward to the next steps on the path to enlightenment – and ready the whip for deviation.

Facebook’s Move to “Openness” Setting de facto Standard?

Yesterday, Facebook took a further step in opening its network by introducing enhancements and new features to its developer APIs. Facebook’s new APIs make it easier for applications to update user statuses, links, and upload videos from outside of Facebook. This effort will likely generate a flurry of activity in the developer community as new applications are created and existing ones enhanced to take advantage of these new capabilities.

[Add to this the earlier announcement of Facebook’s support of OpenID and things are definitely starting to get interesting]

But beyond the power and convenience of integration and data portability from external sources, the real story lies just below the surface. Facebook is striving to become the ultimate repository for all of your social-media information and this is another step along that path. Their platform is becoming a global data-store and their APIs are empowering developers and users with standardized methods of interaction.

On the one hand there is very little about this that is open. Facebook controls the data, its access, and its availability. Facebook defines the integration, they determine the protocols, and the APIs, and even who can and cannot use any of this. This “openness” is all under the oversight, control, direction, and whim of the giant.

Yet, when you think about it, Facebook has made huge strides in extending its world beyond the looming walls of their garden. And, while I don’t think this was their original intent, they have nevertheless listened to their user base and observed the opportunity the market presents.

Some may call it baby steps, others an attempt at world domination. But the winner today is the user (and yes, it’s pretty good for Facebook too!); and the benefits continue to evolve. Along the way, these initiatives will provide new and innovative methods for interaction with users and data that may lead to de facto standards for data portability. Will that actually happen? That depends on Facebook’s “real” position on openness, the user’s tolerance and acceptance of that position, and the response from the other great giant seeking dominance in the global data-store market – Google.