vanderwal.net

Rebuilding My Note Taking and Management System and Model

The past many weeks I have been digging into a better note taking and management method, while also embracing what I have and my core underlying principles. A continual genre in YouTube I watch is around productivity, particularly around personal knowledge management methods and tools. A couple years back I ran into Zettelkasten Method, that comes from Niklas Luhmann, which focuses on his prolific reading and his card catalogue and related note taking system. Then a few months back I heard Jorge Arango’s interview with Beck Tench it drew Zettelkasten back into focus. The interview with Beck focussed on Tinderbox, which I love, but I also want mobile access to my notes from phone and tablet.

Early Exploration

I have been using Notion a little bit, but my only use the last few months is as an interstitial capture for YouTube and some other rich media. [I like Notion and it seems like a modern take on Podio and has a similar downfall of not sorting out an adaptive data structure for interoperability and consistency.] But, the communities that are interested in Notion became obsessed with Roam Research, so I looked at Roam. Roam and Notion are two vastly different approaches, which can complement each other but in to way replace each other. But, each has a similar faults, no API, no standard export for structured information, and fully cloud based. That is too many common failure points wrapped into one product (Notion is working on and API, which is really good). Roam bugged me most because it relies on an outline format but has no clue about OPML exporting, but worse has no good export model. The cloud based, which requires being connected and online is a model I really don’t like as, particularly if their isn’t a local sync nor standard data format model. What I really like about Roam is its block focussed format, that is akin to purple numbers model of small chunks that are addressable and reusable.

In this time of looking what a next generation of quick note taking would look like, but long used tool, NValt failed spectacularly, in that it would not find my directory where my 1,200+ notes were stored, nor could I add new notes. Fortunately all of my notes are in plain markdown text files, so all I was missing was my tagging of the files in NValt (Brett Terpstra who created NValt has been working on a new tool that can replace NValt but has been taking forever to show up and my need became immediate). This is one of the common reasons for owning my own notes and having them locally and not using somebody else’s model and framework. But, also using the [small apps loosely joined] model where many tools pointing at well formatted / structured data / information can function to their best ability and can use their strengths without breaking anything with the information / data.

Seriously Looking at Note Taking and Management Tools

I started looking at about five or six different note taking tools. I was building out a rough attribute model of tools to help see what each offered or didn’t. I am needing to write this up, but it started with watching Mike and Matty’s, Notion vs Roam vs Obsidian vs Remnote - How to best fit note taking app for you and using their criteria as a base, then building on it. Obsidian and Remnote were already on my list, but also included Zettelnote, Zettlr, and a couple that extended Tidlywiki for a Zettelkasten type model. I also included OmniOutliner as that has been (and will be) my core outlining tool that interplays well with OPML and I can back and forth with good mind mapping tools that also output and import OPML data standard. I also included DevonThink Pro as it is my long used (since 2005) note and information storage and smart search tool (it already was indexing my notes directories) that there is no chance I’m going to give up, but also knew it didn’t have the core functionality I was seeking, wiki-style back linking.

I did a quick test or Roam and ruled it out as it broke rules I try not to break, and it broke many of them (biggest one is know now you are going to exit before you enter anything and a lack of any structure nor API made it a giant risk I’ve been burned by too many times, but the developers have a lot of arrogance about their approach that far too often leads to disasters - sometimes the kindest, smartest, and solid planning people end up with disasters that I feel very badly about but arrogance and ignorant I don’t).

Zettlr and Remnote were next. But the setup took a bit more of me managing and building things and I know when I lose focus those may not be best choices for myself (my past self 15 years ago or more would have loved it and done well with it, but those days are not now).

Obsidian Ticks the Right Boxes and Adapts to My Existing Model

Obsidian is where I put some time. I pointed its “Vault” to my notes directory (and sub-directory) where I had my 1,200 markdown notes already (some of them were .txt extensions, which I did bulk extension swap on) and it could read everything perfectly. One of my first tests was adding backlinks to some of my social lenses and social scaling notes, which worked really well by making related elements connected. I started capturing my notes about what I was doing in Obsidian and the ease of not only connecting things with backlinks, but having the ability to set empty node wiki links (many notes with the same link to a note / page that doesn’t exist yet, but have the same link to it) and then being able to use backlink following from that non-existent notes link list of things pointing to it was insanely valuable.

I have quite a few book list and book note pages already and I started linking them and linking authors and making author pages. I also found I was wanting note page templates for simple book pages in a Zettelkasten model, a book notes template, author / creator template, and a few others. I created these from existing structured notes I’ve used for years and put the outlines in TextExpander using a simple input line or two to label all of the headers with author name or other name.

I started typing out my notes and highlights from books I’ve read and annotated over the years and after the first three or so books I was deeply hooked.

The Use Where Obsidian Showed I was Hooked

Where I knew I was sold was this last weekend I went back to one of Matt Webb’s blog posts on Small Groups that is dense and has links out to great resources. I captured my initial notes on Matt’s post, and annotated relating to his sections. But, I also quickly dug through the linked materials and created and filled out structured note pages for those as well. The James Mullholland post on Small Groups was fantastic and it spidered out to more related resources, so I followed those and took notes. All of this was cross-linked and back-linked and fleshed out small group notes that I have been building as part of social scaling I’ve been writing on and presenting (talks and workshops) for years. The small group size they focus on is roughly team size, but not a team. Both of these are cooperative social models, which scale from teams, groups (small to large groups with similar social interaction models, but the dynamics shift quite a bit around 75 people and break fully about 300 to 500 people), community (everybody inside a firewall or inside an walled off construct), and network (inside and outside a firewall - so for business it is customers, contractors, consultants, vendors, etc. where there needs to be a safe model for sharing information with shared goals as different roles with their purpose come together for back and forth exchange) - more can be found in my related write-up 5 Core Insights for Community Platforms Today.

This note taking and contextualizing and cross linking to rip through and gut a series of related and interrelated pieces has been something I’ve long looked for and wanted. Many dog years ago in college I took reading notes on note cards with citations and context. When writing a paper / essay I would assemble the note cards in an order that could tell a story. Then I would build an outline in WordStar and type in the quotes. Then I would write the narrative and wrapper. Obsidian is starting to get at that, but ripping through a resource to pull out highlights, quotes, annotations, and notes is utterly fantastic. It gives me a solid resource to easily pull together ideas and supporting information.

Other Obsidian Capabilities

Obsidian can show two note pages at once so to easily copy book citation information from the structured book note file into the book note page. The multiple notes in panels also works well for copying quotes to quote pages and cross linking.

Using Obsidian and Still Working from Mobile and Tablet

The mobile use essential had been broken for a bit after Dropbox stopped supporting softlinks in Mac and requiring that to be native in Dropbox and doing the softlink from the Mac to Dropbox. I moved the directory to Dropbox, which leaves a copy locally usable should something happen to Dropbox and added a softlink for local backups. I pointed DevonThink to this directory to index and I was back running. Now I can use Drafts to take a quick note from my iOS devices and push it to the notes directory (later go back and fix the file name) and I have good inbound notes and can use backlinks (which I test later). This method also works for share sheet to Drafts from Overcast or YouTube and having the link to the media and the notes all pulled in.

Happiness with notes has been missing for a while, perhaps happiness has returned.

Resources

• Mike and Matty
• Curtis McHale
• Effective Remote Work
• Mariana’s Study Corner

PubPub from MIT Media Lab

I just stumbled into MIT Media Lab’s PubPub service that is an open platform for writing new research journals. It has some nice collaborative features, versioning, embraces markdown at its core, and inline discussions.

Social Circles

One of the pieces I really want to explore is how its social dimensions work. My my take on different things I write and have interest in have different social circles that I want to ping and get feedback from. But, there are subjects and groups / communities that I really would like to participate in as well. This is a more complicated and complex area that really needs work and focus. Google+ tried this but deeply flubbed it as their circles are based on individual’s perspectives and not socially constructed realities (knowing the boundaries of who is involved in a circle and having really solid social interaction design around that is a basic requirement, something nobody at Google seemed to consider nor have basic foundations in social sciences to understand this basic need). For PubPub, getting these constructs right would be really helpful and make it a really powerful service and platform.

Other than PubPub

PubPub is fairly close to what I was hoping Poetica would become and Draft app. I’ve been thinking about this for The Lenses and its subset, Social Lenses writings. Also just being able to write blogs and get knowledgeable sanity checks on them from others before posting. This is something I was trying to do with Draft app and had some success with people who are familiar with markdown (which is most people I interact with), but alerting people or subsets of groups that there is something I would really like early looks at and feedback is where it falls a bit short. It also seems like Nate Kontny is now more focussed on Highrise (light CRM service that he took over and now is CEO) than Draft. Also with the purchase of Poetica and its imminent shuttering, I’m looking at other options.

Some of what I have interest in can be found in Medium, but I’d rather just syndicate there, given their use policy. Medium is a really nice content creation platform, with some okay drafting with feedback capabilities, but I’m looking for a bit more. I also really prefer Markdown approach these days as it keeps things really light and I can edit and work on writing from most any platform I have with me or at my access, even if I’m lacking a network connection (which is something that is really helpful for focus for me actually).

One PubPub Wish

The one thing I wish PubPub had was an open source version where I owned the platform and could run it on a server of my choosing. But, it looks like this is in the plans (a few bugs need to be squashed on their way to this), as the PubPub About page states.

The Humanity of it All

This morning started with my early morning reading and I found Om Malik Interviews Brunello Cucinelli after a more somber stretch of reading.

Om’s interview is a breath of fresh air for me. There is so much in this piece that resonates with understanding not only quality of product, but quality of life and living. There is so much wisdom and understanding the humanity of life and living. Not only are many of our social platforms missing this, but our work and the environments where we live.

There is so much that is fantastic in this piece, but the focus on sane work life and real balance is great to see. Also the focus on ensuring the whole ecosystem is sustainable and thriving is essential. But, the slice of this where Bruello says, “We need a new form of capitalism, a contemporary form of capitalism. I would like to add “humanistic” to that equation” is key. The article mentions “human” 15 times and to me bringing humanity into our work focus and life focus is essential.

There are so many good things in this it may be the best thing I have read in a while, but also highly likely to reread a few times.

Thank you Om

KM World 2014 Wrap

I spent much of this week at KM World 2014 in Washington, DC and the past few days I was working on notes and blog posts for here, but time to get them in readable form and posted wasn’t quite there, so today they became a Personal InfoCloud post, KM World 2014 is a Real Gem.

I had a great time with fantastic people whom I’ve known and people new to me. I spent a lot of time talking about work projects and being back on the consulting side again, but also getting content out and what makes sense with prioritization. I had a lot of great meetings and less formal chats about the state of things as well as trying out some metaphors for framing some things to gage how well they hold up.

I have a lot of snippets to explore and post that have come out of this past week, but I’m digging out of email, notes, snippets, and other things tucked away from this past week.

Social Design for the Enterprise Workshop in Washington, DC Area

I am finally bringing workshop to my home base, the Washington, DC area. I am putting on a my “Social Design for the Enterprise” half-day workshop on the afternoon of July 17th at Viget Labs (register from this prior link).

Yes, it is a Friday in the Summer in Washington, DC area. This is the filter to sort out who really wants to improve what they offer and how successful they want their products and solutions to be.

Past Attendees have Said...

“A few hours and a few hundred dollar saved us tens of thousands, if not well into six figures dollars of value through improving our understanding” (Global insurance company intranet director)

From an in-house workshop…
“We are only an hour in, can we stop? We need to get many more people here to hear this as we have been on the wrong path as an organization” (National consumer service provider)

“Can you let us know when you give this again as we need our [big consulting firm] here, they need to hear that this is the path and focus we need” (Fortune 100 company senior manager for collaboration platforms)

“In the last 15 minutes what you walked us through helped us understand a problem we have had for 2 years and a provided manner to think about it in a way we can finally move forward and solve it” (CEO social tool product company)

Is the Workshop Only for Designers?

No, the workshop is aimed at a broad audience. The focus of the workshop gets beyond the tools’ features and functionality to provide understanding of the other elements that make a giant difference in adoption, use, and value derived by people using and the system owners.

The workshop is for user experience designers (information architects, interaction designers, social interaction designers, etc.), developers, product managers, buyers, implementers, and those with social tools running already running.

Not Only for Enterprise

This workshop with address problems for designing social tools for much better adoption in the enterprise (in-house use in business, government, & non-profit), but web facing social tools.

The Workshop will Address…

Designing for social comfort requires understanding how people interact in a non-mediated environment and what realities that we know from that understanding must we include in our design and development for use and adoption of our digital social tools if we want optimal adoption and use.

• Tools do not need to be constrained by accepting the 1-9-90 myth.
• Understanding the social build order and how to use that to identify gaps that need design solutions
• Social comfort as a key component
• Matrix of Perception to better understanding who the use types are and how deeply the use the tool so to build to their needs and delivering much greater value for them, which leads to improved use and adoption
• Using the for elements for enterprise social tool success (as well as web facing) to better understand where and how to focus understanding gaps and needs for improvement.
• Ways user experience design can be implemented to increase adoption, use, and value
• How social design needs are different from Web 2.0 and what Web 2.0 could improve with this understanding

More info...

For more information and registration to to Viget Lab's Social Design for the Enterprise page.

I look forward to seeing you there.

Stewart Mader is Now Solo and One to Watch and Hire

There seems to be many people that are joining the ranks of solo service providers around social tools. Fortunately there are some that are insanely great people taking these steps. Stewart Mader is one of these insanely great people now fully out on his own. Stewart Mader's Wiki Adoption Services are the place to start for not only initial stages of thinking through and planning successful wiki projects, but also for working through the different needs and perspectives that come with the 6 month and one year realizations.

Those of you not familiar with Stewart, he wrote the best book on understanding wikis and adoption, Wikipatterns and is my personal favorite speaker on the subject of wikis. Others may have more broadly known names, but can not come close to touching his breadth nor depth of knowledge on the subject. His understandings of wikis and their intersection with other forms and types of social tools is unsurpassed.

I welcome Stewart to the realm of social tool soloists experts. I look forward to one day working on a project with Stewart.

Getting Info into the Field with Extension

This week I was down in Raleigh, North Carolina to speak at National Extension Technology Conference (NETC) 2008, which is for the people running the web and technology components for what used to be the agricultural extension of state universities, but now includes much more. This was a great conference to connect with people trying to bring education, information, and knowledge services to all communities, including those in rural areas where only have dial-up connectivity to get internet access. The subject matter presented is very familiar to many other conferences I attend and present at, but with a slightly different twist, they focus on ease of use and access to information for everybody and not just the relatively early adopters. The real values of light easy to use interfaces that are clear to understand, well structured, easy to load, and include affordance in the initial design consideration is essential.

I sat in on a few sessions, so to help tie my presentation to the audience, but also listen to interest and problems as they compare to the organizations I normally talk to and work with (mid-size member organizations up to very large global enterprise). I sat in on a MOSS discussion. This discussion about Sharepoint was indiscernible from any other type of organization around getting it to work well, licensing, and really clumsy as well as restrictive sociality. The discussion about the templates for different types of interface (blogs and wikis) were the same as they they do not really do or act like the template names. The group seemed to have less frustration with the wiki template, although admitted it was far less than perfect, it did work to some degree with the blog template was a failure (I normally hear both are less than useful and only resemble the tools in name not use). [This still has me thinking Sharepoint is like the entry drug for social software in organizations, it looks and sounds right and cool, but is lacking the desired kick.]

I also sat down with the project leads and developers of an eXtension wide tool that is really interesting to me. It serves the eXtension community and they are really uncoupling the guts of the web tools to ease greater access to relevant information. This flattening of the structures and new ways of accessing information is already proving beneficial to them, but it also has brought up the potential to improve ease some of the transition for those new to the tools. I was able to provide feedback that should provide a good next step. I am looking forward to see that tool and the feedback in the next three to six months as it has incredible potential to ease information use into the hands that really need it. It will also be a good example for how other organizations can benefit from similar approaches.

Comments are open (with usual moderation) at this post at Getting Info into the Field with Extension :: Personal InfoCloud.

Explaining the Granular Social Network

This post on Granular Social Networks has been years in the making and is a follow-up to one I previously made in January 2005 on Granular Social Networks as a concept I had been presenting and talking about for quite some time at that point. In the past few years it has floated in and out of my presentations, but is quite often mentioned when the problems of much of the current social networking ideology comes up. Most of the social networking tools and services assume we are broadline friends with people we connect to, even when we are just "contacts" or other less than "friend" labels. The interest we have in others (and others in us) is rarely 100 percent and even rarer is that this 100 percent interest and appreciation is equal in both directions (I have yet to run across this in any pairing of people, but I am open to the option that it exists somewhere).

Social Tools Need to Embrace Granularity

What we have is partial likes in others and their interests and offerings. Our social tools have yet to grasp this and the few that do have only taken small steps to get there (I am rather impressed with Jaiku and their granular listening capability for their feed aggregation, which should be the starting point for all feed aggregators). Part of grasping the problem is a lack of quickly understanding the complexity, which leads to deconstructing and getting to two variables: 1) people (their identities online and their personas on various services) and 2) interests. These two elements and their combinations can (hopefully) be seen in the quick annotated video of one of my slides I have been using in presentations and workshops lately.

Showing Granular Social Network

Granular Social Network from Thomas Vander Wal on Vimeo.

The Granular Social Network begins with one person, lets take the self, and the various interest we have. In the example I am using just five elements of interest (work, music, movies, food, and biking). These are interest we have and share information about that we create or find. This sharing may be on one service or across many services and digital environments. The interests are taken as a whole as they make up our interests (most of us have more interests than five and we have various degrees of interest, but I am leaving that out for the sake of simplicity).

Connections with Others

Our digital social lives contain our interests, but as it is social it contains other people who are our contacts (friends is presumptive and gets in the way of understanding). These contacts have and share some interests in common with us. But, rarely do the share all of the same interest, let alone share the same perspective on these interests.

Mapping Interests with Contacts

But, we see when we map the interests across just six contacts that this lack of fully compatible interests makes things a wee bit more complicated than just a simple broadline friend. Even Facebook and their touted social graph does not come close to grasping this granularity as it is still a clumsy tool for sharing, finding, claiming, and capturing this granularity. If we think about trying a new service that we enjoy around music we can not easily group and capture then try to identify the people we are connected to on that new service from a service like Facebook, but using another service focussed on that interest area it could be a little easier.

When we start mapping our own interest back to the interest that other have quickly see that it is even more complicated. We may not have the same reciprocal interest in the same thing or same perception or context as the people we connect to. I illustrate with the first contact in yellow that we have interest in what they share about work or their interest in work, even though they are not stating or sharing that information publicly or even in selective social means. We may e-mail, chat in IM or talk face to face about work and would like to work with them in some manner. We want to follow what they share and share with them in a closer manner and that is what this visual relationship intends to mean. As we move across the connections we see that the reciprocal relationships are not always consistent. We do not always want to listen to all those who are sharing things, with use or the social collective in a service or even across services.

Focus On One Interest

Taking the complexity and noise out of the visualization the focus is placed on just music. We can easily see that there are four of our six contacts that have interest in music and are sharing their interest out. But, for various reasons we only have interests in what two of the four contacts share out. This relationship is not capturing what interest our contacts have in what we are sharing, it only captures what they share out.

Moving Social Connections Forward

Grasping this as a relatively simple representation of Granular Social Networks allows for us to begin to think about the social tools we are building. They need to start accounting for our granular interests. The Facebook groups as well as listserves and other group lists need to grasp the nature of individuals interests and provide the means to explicitly or implicitly start to understand and use these as filter options over time. When we are discussing portable social networks this understanding has be understood and the move toward embracing this understanding taken forward and enabled in the tools we build. The portable social network as well as social graph begin to have a really good value when the who is tied with what and why of interest. We are not there yet and I have rarely seen or heard these elements mentioned in the discussions.

One area of social tools where I see this value beginning to surface in through tagging for individuals to start to state (personally I see this as a private or closed declaration that only the person tagging see with the option of sharing with the person being tagged, or at least have this capability) the reasons for interest. But, when I look at tools like Last.fm I am not seeing this really taking off and I hear people talking about not fully understanding tagging as as it sometimes narrows the interest too narrowly. It is all an area for exploration and growth in understanding, but digital social tools, for them to have more value for following and filtering the flows in more manageable ways need to more in grasping this more granular understanding of social interaction between people in a digital space.

Denning and Yaholkovsky on Real Collaboration

The latest edition of the Communications of the ACM (Volume 51, Issue 4 - April 2008) includes an article on Getting to "we", which starts off by pointing out the misuse and mis-understanding of the term collaboration as well as the over use of the practice of collaboration when it is not proper for the need. The authors Peter Denning and Peter Yaholkovsky break down the tools needed for various knowledge needs into four categories: 1) Information sharing; 2) Coordination; 3) Cooperation; and Collaboration. The authors define collaboration as:

Collaboration generally means working together synergistically. If your work requires support and agreement of others before you can take action, you are collaborating.

The article continues on to point out that collaboration is often not the first choice of tools we should reach for, as gathering information, understanding, and working through options is really needed in order to get to the stages of agreement. Their article digs deeply into the resolving "messy problems" through proper collaboration methods. To note, the wiki - the usual darling of collaboration - is included in their "cooperation" examples and not Collaboration. Most of the tools many businesses consider in collaboration tools are in the lowest level, which is "information sharing". But, workflow managment falls into the coordination bucket.

This is one of the better breakdowns of tool sets I have seen. The groupings make a lot of sense and their framing of collaboration to take care of the messiest problems is rather good, but most of the tools and services that are considered to be collaborations tools do not even come close to that description or to the capabilities required.

[Comments are open at Denning and Yaholkovsky on Real Collaboration :: Personal InfoCloud]

Remote Presentation and Perception Matrix for Social Tools

This post is also found at: Remote Presentation and Perceptions Matrix for Social Tools :: Personal InfoCloud with moderated comments turned on.]

Today I did something I had never done before (actually a few things) I sat in my office in my home and gave a live web video presentation to a conference elsewhere on the globe. I presented my nearly all new presentation, Keeping Up With Social Tagging to the Expert Workshop in: Social Tagging and Knowledge Organization - Perspectives and Potential that was put on by the Knowledge Media Research Center in Tübingen, Germany.

Remote Presentation Feelings

While the remote video presentation is normal for many people inside their large organizations and I have presented at meetings and conferences where my presentation was provided to other location on live video feed (my recent Ann Arbor trip to present at STIET was HD broadcast to Wayne State in Detroit), this home office to conference presentation was new to me. The presentation and video link used Adobe Connect, which allowed me to see whom I was talking to, manage my slides, text chat, and see myself. This worked quite well, much better than I expected. I did have my full slide presentation in lightroom view set up in Keynote on my external monitor on the side and used Awaken on the side monitor as well to help with timing.

The ability to get feedback and watch the attendees body language and non-verbal responses was insanely helpful. I have given webinars and done phone presentations where I had not visual cues to the audience responses, which I find to be a horrible way to present (I often will expand on subjects or shorten explanations based on non-verbal feedback from the audience). Adobe Connect allowed this non-verbal feedback to be streamed back to me, which completely allows me to adjust the presentation as I normally do.

One thing that was a wee bit difficult was having to change focus (I suppose that comes with use and experience), but I would watch audience feedback while presenting, peek to the side to see where I was with time and slides (to work in the transitions), but would then try to look at the camera to "connect". Watching myself on the video feedback the moments I would try to connect through the camera I would open my eyes wide as if trying to see through my iSight and boy does that come across looking strange on a close range camera. I also (unknown to myself until recently watching a video of another presentation I had done) use a similar facial expression to add emphasis, I am realizing with a camera as close as it is for web presentation also really looks odd. I am sort of used to listening to myself (normally to write out new analogies I use or responses to questions), but watching myself in playback from that close of a range is really uncomfortable.

One thing I really missed in doing this web video presentation was extended interaction with the attendees. I rather enjoy conferences, particularly ones with this focussed a gathering as it makes for great socializing with people passionate about the same subjects I am passionate about. I like comparing note, perceptions, and widely differing views. It helps me grow my knowledge and understandings as well as helps change my perceptions. Live face-to-face conversation and sharing of interests is an incredibly value part of learning, experiencing, and shaping views and it is something I greatly enjoy attending conferences in person. I am not a fan of arriving at a conference just prior to a presentation, giving the presentation, and then leaving. The personal social interaction is valuable. The video presentation does not provide that and I really missed it, particularly with the people who are so closely tied to my deep interest areas as this workshop was focused.

New Content in Presentation

This presentation included a lot of new content, ideas, and concepts that I have not really presented or written about in as open of a forum. I have received really strong positive feedback from the Faces of Perception, Depth of Perception, and Perception Matrix when I have talked about it with people and companies. I have included this content in the book on social bookmarking and folksonomy I am writing for O&Reilly and pieces have been in public and private workshops I have given, but it was long past time to let the ideas out into the open.

The components of perception came about through reading formal analysis and research from others as well as not having a good models myself to lean on to explain a lot of what I find from social computing service providers (web tools in the Web 2.0 genre as well as inside the firewall Enterprise 2.0 tools) as tool makers or service owners. The understandings that are brought to the table on a lot of research and analysis is far too thin and far too often badly confuses the roles and faces of the tool that are being reviewed or analyzed. In my working with tool makers and organizations implementing social tools the analysis and research is less than helpful and often makes building products that meet the user needs and desires really difficult. I am not saying that this conceptual model fixes it, but from those who have considered what it shows almost all have had realizations they have had a less than perfect grasp and have lacked the granularity they have needed to build, analyze, or research these social tools.

I am hoping to write these perspectives up in more depth at some point in the not too distant future, but the video and slides start getting the ideas out there. As I have been walking people through how to use the tools I have been realizing the content needed to best us the model and matrix may take more than a day of a workshop of even a few days to get the most complete value from it. These tools have helped me drastically increase my value in consulting and training in the very short time I have used them. Some are finding that their copying of features and functionality in other social services has not helped them really understand what is best for their user needs and are less than optimal for the type of service they are offering or believe they are offering.

Yahoo! Makes Good Call on Microsoft Purchase

The Wall Street Journal article about Yahoo! Rejecting Microsoft Bid (many more stories on TechMeme) was one that restored my faith in Yahoo! (not that it was really lost). I am proud of the Yahoo! board, but not for the reasons most are talking about. Since hearing about the Microsoft bid to take over Yahoo! I thought it was a really poor idea, well horrible idea. I really like Yahoo! and a lot of the things they are doing. I also really do like Microsoft (it is just some of their products that frustrate me to no end), in particular I think the MS Live group has come up with some great ideas out of research and that pleases e to know end. I am a giant fan of Ray Ozzie (oh, where have you gone Ray?).

Merger Would be a Giant Culture Clash

Yes, there are the technology concerns with some of the best open and shared technology development and augmentation coming out of Yahoo!, which is counter to the Microsoft focus on using their own tools (most of the web is built on open tools and Yahoo! helps make that a great platform to develop upon). This is not my big concern.

Where I see a giant problem is the management and employee culture. I know and have known a lot of employees and managers (mid-level and upper-level) at both organizations. Microsoft is a tough business culture with keeping the top percentage of employees and contributers on a project and moving others off to find a spot on other projects. In talking with many Microsoft employees (most were in the top performer group) this is often seen as horribly disruptive to the team when the changes occur. This management model also discourages sharing collectively and building collaboratively, which is also stated as a huge problem. These disruptions and metrics that are counter to strong development for the web and quick iterative cycles (not that Yahoo! seems to iterate quickly other than Flickr and a handful of other products) are quite counter to an open shared development process at Yahoo!. The clash of management cultures on this front, unless Microsoft did the unthinkable and adopted the Yahoo! approach, which could fix a lot of what has been holding Microsoft back (well, from current and former employees perspectives).

Related to the performance of employees the management teams go through similar reviews. But, many employees I have talked with (at conferences, networking events, airports and airplanes (there is always one within 10 seats of me it seams), and chat) have been really frustrated with management changes that can occur after 6 to 9 months. Having a new manager often changes focus and direction, which breaks momentum and continuity. Talking with great people Microsoft has lost over the past couple years, this management change was their biggest reason for leaving. The changes in management also often lead to conflicting measurement goals, which would make a great product or team look as if they were not working up to the standards. This is not management, but business process failure. This is not saying Microsoft has poor managers, quite the opposite in fact as many are some of the best I have run across in the business. But, the structure, processes, and measurement that the top management of Microsoft has established seems to be what has inhibited Microsoft from really top performance. What may work for some parts of Microsoft does not seem to work for other areas (actually, of all the Microsoft employees I have talked with from all across the organization the model does not work outside of sales).

The Yahoo! management has had more than their share of restructuring, but the disruptions this has made to product development and progress have been minimal. The goals, direction, and means to get the job done do not change for the most part (from what I have heard). Employees are flustered, but not demoralized. Yahoo! seems to have much greater continuity and central focus. Their products are well known, well used, and they iterate (over time). Many discussions with Yahoo! employees and managers outside the walls of Yahoo! are more frustrated by the silos and inability to work across the silos, but some the restructuring in the past couple of years has helped move to alleviate these problems. The cross platform team that works to help research, understand, and develop best of class solutions is a great step in this direction (from the perspective of many within Yahoo!). Yahoo! has known what has been holding back its efforts (Panama ate focus and resources) and has taken steps to alleviate the problems and move in a new positive direction. There are many things in Yahoo! that were more transparent two years ago than they are now (part of that may be those talking about things openly have been insanely busy). One of the things that seems to be problematic (from an outsider's perspective) is blinder focus and lack of concurrent development within groups.

Sum of Parts are Not Positive

When looking at the two cultures of the companies they are incredibly polar. One of the first steps in looking at a purchase or merger must be to look at compatibility of the cultures. Sure the products and services look like they may be a good fit by some at Microsoft, but those products and services are built by people with in a culture that propagates an environment to build wonderful things. Breaking that culture (Microsoft repeatedly iterated the vast savings the combination of MS and Y! would make) through integration of polar cultures has the high probability of destroying the value of what you believe will help. In this case a one plus one could equal less than one.

Partnering Not Combining

Yahoo! and Microsoft could have increased value partnering and working together though a Microsoft investment. What and how I do not know, but Microsoft needs positive outcomes and Yahoo! could use some financial boosts. Microsoft could also use a culture change, but that does not seem to be with in their vision as of yet and it is a huge organization to move in a new direction.

Yahoo! could improve its lot with partnerships, be it Microsoft, Ebay, Murdoch, Time Warner (AOL), and Google. I really do not want to see the Yahoo! search engine go away as the competition is good and provides alternatives should something go wrong with a one player or few player marketplace (oligopoly).

Social Computing Summit in Miami, Florida in April, 2008

ASIS&T has a new event they are putting on this year, the Social Computing Summit in Miami, Florida on April 10-11, 2008 (a reminder page is up at Yahoo's Upcoming - Social Computing Summit). The event is a single-track event on both days with keynote presentations, panels, and discussion.

The opening keynote is by Nancy Baym. I have been helping assist with organization of the Social Computing Summit and was asked by the other organizers to speak, which I am doing on the second day. The conference is a mix of academic, consumer, and business perspectives across social networking, politics, mobile, developing world, research, enterprise, open social networks (social graph and portable social networks) as well as other subjects. The Summit will be a broad view of the digital social world and the current state of understanding from various leaders in social computing.

There is an open call for posters for the event that closes on February 25, 2008. Please submit as this is looking to be a great event and more perspectives and expertise will only make this event more fantastic.

Facebook for Business or LinkedIn Gets More Valuable

Michael Arrington writes about Facebook has LinkedIn in their Crosshairs, but I have been finding Facebook becoming increasingly less valuable the more people I have connected in it. The converse is opposite for me, LinkedIn becomes incredibly more valuable the more people I have in it. The reason for my derived value is simplicity.

LinkedIn Scales Quite Well the More Connections a Person Has

LinkedIn focusses on a simple set of things (your connections, changes to your connections, simple activities by your connections, and connecting with other people) and lets the person using the service derive value. LinkedIn lets be easily download the updated vCard, which drops into my address book in two different applications, which I have syncing with my mobile device (now that I have a mobile device that does not suck). LinkedIn is partly passive for me as I leave it own in a tab in my browser and check it a few times a day, but where a contact updates their status I can update my address book and it is a trigger for me to send a note, using the services they prefer (I keep track of that). LinkedIn is moving to opening its service with an API as they blogged (The LinkedIn API Opportunity). This will permit other services that can add value and are also great at what they do to pair the services, like Dopplr or a calendar to show availability (a particular need of mine). LinkedIn understands the information in their service has value and is more valuable outside their service for many people. But, LinkedIn also understands a good interface that is not cluttered, and there for it can scale.

Facebook Scales Poorly the More People A Person is Connected To

Facebook has a few things going for it, a huge mass of people with accounts and it has a fairly good lifestream interface for one's friends. The value for people using Facebook for themselves is much less than the high dollar valuations given to it (the valuation is not because it is a great service or tool, but because they have a ton of accounts in the service that creates value for advertisers). A few weeks ago I posted some Facebook frustrations in Twitter that stated:

"Facebook is driving me absolutely nuts - there is no way to manage information or conversations"

"Facebook is like a grade school lunch room, cacophony and chaos as the rule of nature"

&auot;FAcebook has a lot of valuable bits of information flowing through it from my contacts, but it FAILS to allow be to do anything with them"

Unlike Twitter, which allows me to favorite bits of information that I find valuable, Facebook does not grasp that the information has value. They do not grasp that those of us people who use their service are sharing things with those we connect with (friends, acquaintances, work relations, etcera) and we would like these people to see this information. Facebook interface started breaking for me finding information shared for my seeing (along with many others) with about 75 connections. It became virtually unusable with 150 people. There is information about events, blog posts, published journal articles, job changes, travel to cities I will be in (the Dopplr application is helpful, but if does not make a connection to those people in Facebook and the information I should be seeing), and other helpful valuable information for me.

Not only was I having this problem, but I was getting many e-mails and messages through Twitter with my friends and contacts severe problems with the poor (at best) Facebook platform. Nearly every person I heard from had many instances of broken communication because Facebook has yet to sort out volumes of information and surface it in a manner that can be valuable for the people it is intended to communicate with.

Facebook developers have a huge amount of learning about information, information flow, and information use in people's lives. Information is part of social interaction and what makes literate beings stand out is doing something, often using and reusing information. One common statement about Facebook from friends of all ages is it is a service to connect to people and play Scrabble on, but that is the end of the value. Facebook really needs to wake up and build real APIs that allow ease of holding on to the information people share as part of their being social humans sharing. When Facebook broke the FacebookSync.app it ruined one of the solid values Facebook provided, updating my address book with ease from information my friends were sharing with me.

Facebook Groups Have Learned Nothing from Group Messaging Platforms

One area that is really frustrating is Facebook#039;s groups. Many groups start with good intentions of providing a place to gather and message around a subject area. But, most groups already have listserves and other discussion platforms and the walled garden and horrible group discussion board platform make the Facebook platform a distraction and only providing a means for communication fractured across channels. Finding valuable information in Facebook groups or reading and following along is horribly painful, there has been some good advancement in groups discussion forums in the past 20 years, but Facebook seems to have ignored all things good with groups.

There are some exceptions to this rule, as the Facebook group for Victoria Secret Pink has been brought up as an example by more than five of my clients in the last five months or so. The Pink group has good community leaders and engages the people in the group to connect with others.

Successful Social Group Filtering is Needed

One of the fixes that Facebook needs is the same fix that every group discussion platform (listserves, threaded discussions, and web platforms) needs. Popular discussion boards have problems as they scale and over time with repetitive discussions. After people have been lurkers or participants in a discussion services for a few months (some people grasp this much more quickly) trends appear. The trends are the identifying people we find add value for us personally (every person has different valued contributors) and there are subjects that we want to listen to and participate in and those we have little interest in. The next step for these tools will be to surface people we find valued contributions from and subjects we want to pay attention to and others that we want to not listen to (unless one of our valued contributors jumps in the conversation). Not all contributors are valuable to us in all groups, so that needs to have granular listening attributes and we need to have fuzzy semantic terms (we set a word or few and terms that are related to these words will draw our reader's attention and filter them out for us to easily see and follow). These solutions are also needed in RSS feeds and aggregated information services.

The Future of LinkedIn and Facebook

LinkedIn already is a good business tool with value and they need to protect what they do well, which is holding on to people we have met and interacted with outside LinkedIn and use LinkedIn to connect with others with similar interests or needs. Opening up the API for LinkedIn could help people share their linked in profile though mobile devices so to gather a digital business card or easily get a link to it as we meet people, not hours, days, or weeks later.

Facebook has a decent platform that offers more than the pure social network tools before it (Ryze, Friendster, Orkut, or MySpace), but it still has an really long way to go. It gets about 40% right, but it can easily just be another step forward for social networking tools, unless it starts solving some of the difficult problems. A Facebook like tool that gets communication and sharing right at scale for professionals will do really well. Tools like this are needed inside the firewall for enterprise and Facebook does have value in its current state for business, but it is really limited.

The promised addition of grouping contacts in Facebook will help provide a better tool for profession needs separating out value from the playful, but it will need a lot more than that. Facebook really needs to open up and to get a clue about people and information and the needs people have for information, such as holding on to that information and using it outside the system. Facebook is just fodder for the next social software service that does this right, on top of the 45% of things that Facebook got right and be the next media darling worth billions that never amounted to much.

A Stale State of Tagging?

David Weinberger posted a comment about Tagging like it was 2002, which quotes Matt Mower discussing the state of tagging. I mostly agree, but not completely. In the consumer space thing have been stagnant for a while, but in the enterprise space there is some good forward movement and some innovation taking place. But, let me break down a bit of what has gone on in the consumer space.

History of Tagging

The history of tagging in the consumer space is a much deeper and older topic than most have thought. One of the first consumer products to include tagging or annotations was the Lotus Magellan product, which appeared in 1988 and allowed annotations of documents and objects on one's hard drive to ease finding and refinding the them (it was a full text search which was remarkably fast for its day). By the mid-90s Compuserve had tagging for objects uploaded into its forum libraries. In 2001 Bitzi allowed tagging of any media what had a URL.

The down side of this tagging was the it did not capture identity and assuming every person uses words (tag terms) in the same manner is a quick trip to the tag dump where tags are not fully useful. In 2003 Joshua Schacter showed the way with del.icio.us that not only allowed identity, upon which we can disambiguate, but it also had a set object in common with all those identities tagging it. The common object being annotated allows for a beginning point to discern similarity of identityĵs tag terms. Part of this has been driven on Joshua's focus on the person consuming the content and allowing a means for that consumer to get back to their information and objects of interest. (It is around this concept that folksonomy was coined to separate it from the content publisher tagging and non-identity related tagging.) This picked up on the tagging for one's self that was in Lotus Magellan and brings it forward to the web.

Valuable Tagging

It was in del.icio.us that we saw tagging that really did not work well in the past begin to become valuable as the clarity in tag terms that was missing in most all other tagging systems was corrected for in the use of a common object being tagged and the identity of the tagger. This set the foundation for some great things to happen, but have great things happened?

Tagging Future Promise

Del.icio.us set many of out minds a flutter with insight into the dreams of the capability of tagging having a good foothold with proper structure under them. A brilliant next step was made by RawSugar (now gone) to use this structure to make ease of disambiguating the tag terms (by appleseed did you mean: Johnny Appleseed, appleseeds for gardening/farming, the appleseed in the fruit apple, or appleseed the anime movie?). RawSugar was a wee bit before its time as it is a tool that is needed after there tagging (particularly folksonomy related tagging systems) start scaling. It is a tool that many in enterprise are beginning to seek to help find clarity and greater value in their internal tagging systems they built 12 to 18 months ago or longer. Unfortunately, the venture capitalists did not have the vision that the creators of RawSugar did nor the patience needed for the market to catch-up to the need in a more mature market and they pulled the plug on the development of RawSugar to put the technology to use for another purpose (ironically as the market they needed was just easing into maturity).

The del.icio.us movement drove blog tags, laid out by Technorati. This mirrored the previous methods of publisher tagging, which is most often better served from set categories that usually are derived from a taxonomy or simple set (small or large) of controlled vocabulary terms. Part of the problem inherent in publisher tags and categories is that they are difficult to use outside of their own domain (however wide their domain is intended - a specific site or cross-sites of a publisher). Using tags from one blog to another blog has problems for the same reason that Bitzi and all other publisher tags have and had problems, they are missing identity of the tagger AND a clear common object being tagged. Publisher tags can work well as categories for aggregating similar content within a site or set of commonly published sites where a tag definition has been set (but that really makes them set categories) and used consistently. Using Technorati tag search most often surfaces this problem quickly with many variation of tag use surfacing or tag terms being used to attract traffic for non-related content (Technorati's keyword search is less problematic as it relies on the terms being used in context in the content - unfortunately the two searches have been tied together making search really messy at the moment). There is need for an improved tool that could take the blog tags and marry them to the linked items in the content (if that is what is being talked about - discerning predicate in blog tags is not clear yet).

Current Tools that Advanced

As of a year ago there were more than 140 social bookmarking tools in the consumer space, but there was little advancement. But, there are a few services that have innovated and brought new and valuable features to market in tagging. As mentioned recently Ma.gnolia has done a really good job of taking the next steps with social interaction in social bookmarking. Clipmarks pioneered the sub-page tagging and annotation in the consumer tagging space and has a really valuable resource in that tool. ConnectBeam is doing some really good things in the enterprise space, mostly taking the next couple steps that Yahoo MyWeb2 should have taken and pairing it with enterprise search. Sadly, del.icio.us (according to comments in their discussion board) is under a slow rebuilding of the underlying framework (but many complaints from enterprise companies I have worked with and spoken indepth with complain del.icio.us continually blocks their access and they prefer not to use the service and are finding current solutions and options to be better for them).

A Long Way to Go

While there are examples that tagging services have moved forward, there is so much more room to advance and improve. As people's own collection of tagged pages and objects have grown the tools are needed to better refind them. This will require time search and time related viewing/scanning of items. The ability to use co-occurance of tag terms (what other tags were used on the object), with useful interfaces to view and scan the possibilities.

Portability and interoperability is extremely important for both the individual person and enterprise to aggregate, migrate, and search across their collections across services and devices (now that devices have tagging and have had for some time, as in Mac OS X Tiger and now Vista). Enterprises should also have the ability to move external tagged items in through their firewall and publish out as needed, mostly on an employee level. There is also desire to have B2B tagging with customers tagging items purchased so the invoicing can be in the customers terminology rather than the seller terminology.

One of the advances in personal tagging portability and interoperability can easily be seen when we tag on one device and move the object to a second device or service (parts of this are not quite available yet). Some people will take a photo on their mobile phone and add quick tags like "sset" and others to a photo of a sunset. They send that photo to a service or move it to their desktop (or laptop) and import the photo and the tag goes along with it. The application sees the "sset" and knows the photo was transfered from that person's mobile device and knows it is their short code for "sunset" and expands the tag to sunset accordingly. The person then adds some color attribute tags to the photo and moves the photo to their photo sharing service of choice with the tags appended.

The current tools and services need tools and functionality to heal some of the messiness. This includes stemming to align versions of the same word (e.g. tag, tags, tagging, bookmark, bookmarking). Tag with disambiguation in mind by offering co-occurrence options (e.g. appleseed and anime or johnny or gardening or apple). String matching to identify facets for time and date, names (from your address book), products, secret tag terms (to have them blocked from sharing), etc. (similar to Stikkit and GMail).

Monitoring Tools

Enterprise is what the next development steps really need to take off (these needs also apply to the power knowledge worker as well). The monitoring tools for tags from others and around objects (URLs) really need to fleshed out and come to market. The tag monitoring tools need to become granular based on identity and co-occurance so to more tightly filter content. The ability to monitor a URL and how it is tagged across various services is a really strong need (there are kludgy and manual means of doing this today) particularly for simple and efficient tools (respecting the tagging service processing and privacy).

Analysis Tools

Enterprise and power knowledge workers also are in need of some solid analysis tools. These tools should be able to identify others in a service that have similar interests and vocabulary, this helps to surface people that should be collaborating. It should also look at shifts in terminology and vocabulary so to identify terms to be added to a taxonomy, but also provide an easy step for adding current emergent terms to related older tagged items. Identify system use patterns.

Just the Tip

We are still at the tip of the usefulness of tagging and the tools really need to make some big leaps. The demands are there in the enterprise marketplace, some in the enterprise are aware of them and many more a getting to there everyday as the find the value real and ability to improve the worklife and workflow for their knowledge workers is great.

The people using the tools, including enterprise need to grasp what is possible beyond that is offered and start asking for it. We are back to where we were in 2003 when del.icio.us arrived on the scene, we need new and improved tools that understand what we need and provide usable tools for those solutions. We are developing tag islands and silos that desperately need interoperability and portability to get real value out of these stranded tag silos around or digital life.

The Social Enterprise

I am just back from Enterprise 2.0 Conference held in Boston, where I presented Bottom-up All The Way Down: How Tags Help Businesses Organize (thanks to Stowe Boyd for the tantalizing session title), which was liveblog captured by Sandy Kemsley as "Enterprise 2.0: Thomas Vander Wal". I did not catch all of the conference due to some Boston business meetings and connecting with friends and meeting digi-friends whose work I really enjoy face-to-face. The sessions I made it to were good and enlightening and as always the hallway conversations were worth their weight in gold.

Ms. Perceptions and Fear Inside the Corporate Walls

Having not been at true business focussed conference in years (until the past few weeks) I was amazed with how much has changed and how much has stayed the same. I was impressed with the interest and adoption around the social enterprise tools (blogs, wikis, social bookmarking/folksonomy, etc.). But, the misperceptions (Miss Perceptions) are still around and have grown-up (Ms. Perception) and are now being documented by Forrester and others as being fact, but the questions are seemingly not being asked properly. Around the current social web tools (blogs, wikis, social bookmarking, favoriting, shared rating, open (and partially open collaboration) I have been finding little digital divide across the ages. Initially there is a gap when tools get introduced in the corporate environment. But this age gap very quickly disappears if the incredible value of the tools is made clear for peoples worklife, information workflow, and collaboration, as well as simple instructions (30 second to 3 minute videos) and simply written clear guidelines that outline acceptable use of these tools.

I have been working with technology and its adoption in corporations since the late 80s. The misperception that older people do not get technology, are foreign to the tools, and they will not ever get the technical tools has not changed. It is true that nearly all newer technologies come into the corporation by those just out of school and have relied on these tools in university to work intelligently to get their degree. But, those whom are older do see the value in the tools once they have exposure and see the value to their worklife (getting their job done), particularly if the tools are relatively simple to use and can be adopted with simple instruction (if it needs a 10 to 200 page manual and more than 15 minutes of training to start using the product effectively adoption will be low). Toby Redshaw of Motorola stated on a panel that he found in Motorola (4600 blogs and wikis and 2600 people using social bookmarking) "people of all ages adopt these tools if they understand the value connected to their work". Personally, I have seen this has always been the case in the last 20 years as this is how we got e-mail, messaging, Blackberries, web pages, word processing, digital collaboration tools (the last few rounds and the current ones), etc. in the doors of small to large organizations. I have worked in and with technically forward organizations and ones that are traditionally thought of as slow adopters and found adoption is based on value to work and ease of use and rarely based on age.

This lack of understanding around value added and (as Toby Redshaw reinforced) "competitive advantage" derived from the social tools available today for use in the enterprise is driven by fear. It is a fear of control that is lost from the top-down. But, the advantage to the company from having this information shared and easy found and used for collaboration to improve knowledge, understanding, and efficiency can not be dismissed and needs to be embraced. The competitive advantage is what is gained today, but next month or next quarter it could mean just staying even.

Getting Beyond Fear

But, what really is important is the communication and social enterprise tools are okay and add value, but the fear is overplayed, as a percentage rarely occurs, and handling the scary stuff it relatively easy to handle.

Tagging and Social Bookmarking in Enterprise

In the halls I had many conversations around tagging ranging from old school tagging being painful because the experts needed to tag things (meaning they were not doing the job as expert they were hired to do and their terms were not widely understood) all the way to the social bookmarking tools are not scaling and able to keep up with the complexity, nor need to disambiguate the terms used. But, I was really impressed with the number of organizations that have deployed some social bookmarking effort (officially or under somebody's desk) and found value (often great value).

Toby Redshaw: I though folksonomy was going to be some Bob Dillon touchy-feely hippy taxonomy thing, but it has off the chart value far and above any thing we had expected.

My presentation had 80 to 90 percent of the people there using social bookmarking tools in some manner in their organization or worklife. The non-verbal feed back as I was presenting showed interest in how to make better sense of what was being tagged, how to use it better in their business, how to integrate with their taxonomy, and how to work with the information as the tools scale. The answers to these are longer than the hour I have, they are more complex because it all depends on the tools, how they are set-up and designed, how they are used, and the structures of information inside and outside their organization.

The Tension of Sharing

In today's culture there is a serious tension between creative types, publishers & owner of rights, and other creative types. Society and culture has traditionally been handed down through generations and each innovation is built upon. Today we are living in a world that is trying to monetize this sharing and handing from one creator to another, which is placing money as a higher value than advancing culture and society. Today in the New York Times the latest iteration of the clamping down is presented in the article, Now the Music Industry Wants Guitarists to Stop Sharing, which is about sharing guitar tabs online.

We Can Advance Culture and Society Faster Today Than Ever Before

This sharing of guitar tabs has always been around, as has sharing most other music insights from one musician to another. This sharing is how nearly all of us have learned, embraced, and improved our skills. Not only do musicians learn this way, just as they always have, but it also how designers learn and share. The web not only made this quicker and easier, but web designers and developers have always been able to peek at the under pinnings of each others markup and design. This sharing helped move the web along more quickly than many technologies and mediums that came before it. The web is built on a creative culture mindset of free sharing. Part of this extension is nearly all creative cultures have advanced in recent years because of the web. Creativity has been democratized and the ability to get from zero to 7 is made very easy. It has been a time of immense innovation and a vast spreading of innovation.

One of the odd things is the corporate culture, which does not move at as fast of a pace (look at the ironic juxtaposition of Microsoft, which enabled innovation and was incredibly innovative, often by using the innovation of others (bought or "borrowed") is not a big corporation that is very slow moving and more reactive than innovative (on a whole, as I do realize there are some incredibly innovative segments inside Microsoft - particularly in the Live area and things that Ray Ozzie touches). It is the corporate culture of those that do not create but try and "own" what is the result of the creative process that are trying to stand in the way of traditional sharing in society and culture. It is ironic that what they spend their time suing to inhibit is what created the items of value they are claiming they are protecting.

Creativity Needs Sharing and It will Find Ways Around Control

There are many ironies in the top-down control industry, in that they are trying to kill what makes them money. The RIAA has tried to kill peer-to-peer sharing, but with the horrible state of radio the best way to learn about new music is to use peer-to-peer services. Recent studies show nearly all of the music on in iTunes and iPods is actually owned by the person using that device. Research around how people find the music they purchase points to open sharing of that music. That is how I do it and many of the others that I know.

Let me illustrate... Recently I ran across a Steely Dan making of Peg video on YouTube, which I really enjoyed. It was about the deep geek side of musicians sharing how they recorded and produced their hit song Peg. They were sharing their secrets, for a small price. But in this instance it was free on YouTube. I doubt that Steely Dan or anybody related to the DVD that this video came from authorized its use. But, because of watching the YouTube segment I bought the Steely Dan Aja DVD. I would have never known about it had I not run across the sample on YouTube. Not only did I buy it but in my circle of friends I know seven others that did the exact same thing, watched it on YouTube and then bought it.

This is a story of free sharing about musicians sharing their craft with others so to improve upon the whole of the craft. This is the thing that the New York Times article highlights as being a problem. But, it is the corporations around creativity that have put a noose around their prospective industries by getting their friends in U.S. Congress to regulate sharing and creativity and make it a crime in the Digital Millenium Copyright Act (PDF).

I am finding that much of the music I enjoy is not coming out of the corporations, but the creators and innovators who are connecting with their audience directly. Last evening I watched a video on YouTube that we are interested in picking up. I clicked a little bit on YouTube and discovered The Dualers from London, who I am quite impressed with. The Dualers are a ska/raggae duo/band who do not have backing of a record company, but made it into the pop charts in 2004 and stayed there for a bit. Ska/raggae is a type of music that is out of fashion with the record companies, but still has a large following. It is music that still resonates not too far out in the long tail. YouTube is one of the means that The Dualers promote their works. They have sold over 35,000 CDs, which is atleast $350,000 if they are sold for $10 a pop, which would be much better than a deal a record company could offer them starting out.

How to Ease the Tension?

A large part of fixing the current problem is fixing the laws and getting people in upper management and in control of the media companies organization that litigate rather than adapt. We need to return to embracing creativity and sharing. We need to do this in a manner that creators can make a living, which may include cutting back on the role of the middle men. I see a shift toward media outlets that can innovate, iterate, and help support the creators as well as support the media outlets. The radio industry is in serious trouble in its current iteration and may need to move to a more segmented and broader distribution like XM and/or Yahoo Music and LastFM and MySpace as social means of finding new music and connecting directly with bands/creators.

I have been quite interested in some of the stories about EMI and how they have added value, creativity, and innovation for Gorillaz and even Coldplay. It seems that EMI pays attention to the community and lets the artists connect with their audience, which then helps shape their music and creativity. This sounds like the smart leadership that is needed. I have only heard these stories anecdotally, so I am not sure how much is really done by the community with interest or the artists. But, I can hope.

Platial Turning it Up

A few months ago a couple of friends pointed me to Platial a social geo-annatation site that is build on top of the Google map API. As luck would have it I met up with the creators and developers of Platial while in Amsterdam at XTech 2006. I was in deep "just got off an overnight flight" syndrome, but really enjoyed talking with them non-the-less.

Platial is headquartered in Portland, Oregon and on my recent trip I stopped in to say hello. Not only do they have killer developers and staff, an incredible workspace, but great things are coming to Platial. I left even more impressed with the tool and the direction it is heading than I was prior.

If you have not tried it, head on over and give it a try. Remember to keep coming back as they have more killer stuff in the pipeline.

Is Mechanical Turk for Digital Human Filters?

The New York Times article, Software to Look for Experts Among Your Friends, brought to mind a couple conversations from my recent trip to Amsterdam. At XTech there were a couple presentations about Mechanical Turk (as well as other Amazon web services) and the big question was "what is a killer application for Mechanical Turk?" Many of us through out suggestions, many good, but I have kept thinking about one.

The one killer application is not really a problem a human solves, but the collective interests and amalgamation of information and trained services humans use and have trained. You see, for me Yahoo's MyWeb 2.0 is my killer search solution as it pays attention to what I and my "community" have interest in and mirrors our vocabulary (we used our own vocabulary to tag items of interest on the web in the MyWeb social bookmarking tool). These items of interest in MyWeb 2.0 are offered to me first in my web searches and more often than not what I am seeking is in this collection of mine or my contact's.

These searches that are based on human filters and collaborative filtering of information and structuring what we find of interest and bookmark bringing the information out from 5 to 40 pages deep in the web. It mirrors our interests and perspectives. But, what if we need information outside of our own interests? Now we need not our own corpus of items and possibly one outside those in our loose collective. Let us think I need information about transmission of disease between monkeys. This is not something I have interest in and I am not sure anybody I know (or would be couple of degrees of separation away) would have interest in. This is where I would love to turn to Mechanical Turk to use the filtering and aggregation capabilities of another person's life filtering. I may not want to add the monkey disease transmission to my own corpus, but I need to use a corpus of somebody who has this interest. In a sense I need to uses somebody's digital brain and information attraction mechanisms.

I am not sure if this is really a job for Mechanical Turk, but it requires another person's interests and permission. The Tacit company seems to have a similar product, but only works on Windows and most of the people I would want to tap are not Windows users, but most have web-based information resources.

An Overview of the Local InfoCloud is Available

I have finally posted a write-up on Exposing the Local InfoCloud, which explains the attributes and components that comprise the Local InfoCloud. This is a write-up of an explanation that has been bubbling for a couple years and I finally put into a presentation last Fall for Design Engaged. The Local InfoCloud include resources that are familiar to us and can often be the social software elements with which we interact as trusted resources.

During a recent symposium on social software (I attended virtually) there was much grumbling around the term "community" and when I stated I was going to try and redact that term from my usage, I was quickly asked what I was going to replace it with. Community is broadly used and for most of my uses the components in the Local InfoCloud are more distinct pointers to what people can mean when they discuss community. The components are also can help us describe the human and digital resources that bring data, information, and media objects closer to us.

When I have chatted with people about the attributes and components in the past it leads to more questions and wonderful discussions. The point of this piece is to clarify the framework for the Local InfoCloud and capture discussion. I have incorporated the feedback from chats I have had, where it was convincing, relevant, and I was happy with how it jelled. I am looking for more feedback and discussion, which is part of the reason it is posted at the Personal InfoCloud (comments and trackback capabilities are available, but moderated, there).

Post SXSW Reality Change

Getting back from SXSW Interactive is normally a filled with feeling empowered and excited after hanging out with many like minds. This is normally followed by severe reality slap between my mind/soul and my pocketbook. I want to dive in and build and iterate projects, but where I was was not there in that same space I was there bringing them up to where things were in years past and older (sometimes expired) best practices.

I had thought this year I was going to have a similar experience to that of Ethan of feeling a let down not having people to talk to about the experience. Somehow I have kept the high from SXSW, in-fact I have been filling in the gaps on panels I did not make it to and deeply wished I had made it to by reading other's reviews and presenter's slides.

I think my changed experience is largely due to changing my surroundings this past year to focus on clients that really want to build services and a web that goes beyond the page and resonates in people's lives so that what they offer can be used and reused as people actually want and need to do in their life. As well I have been doing the same around tagging and folksonomy, which blends into social networking and refindability. Lastly I dove back into a project that I have been working on since November of last year, thanks to my trip to London, which is where the light went on and the project started getting framed and built in spare time (with the help of another with a tiny slice of time).

I have been increasingly putting my developer hat back on and scratching my own itch, while pulling in resources to make all of this come to life. SXSW helped put this into perspective. Now I just need to get my taxes and other corporate administrative stuff out of the way to build and finish preparing for the IA Summit in Vancouver, BC

Folksonomy in Physical Space

An example of folkonomy beyond the web. In a Flickr comment the person describes objects they found and strangers properly annotated. Folksonomy is not the content owner or creator tagging and annotating it is others.

This is quite apropos as Flickr, while not offering full tagging by others (if a photo is tagged orange, there is no reason (or way) for others to additionally tag the photo orange, which I wish would get fixed) Flickr does offer the ability for others to comment fully and add knowledge (or humor) to the photos. The string of comments, which this example is pulled is from a query Esther Dyson posted about the type of tree she photographed. Knowledge does not have to come from within but can come from around us as a collective.

ETech is Emergent? [updated]

I thought this would be the year I was going to ETech, but with a few other things going on it was not the year. I have many friends that go each year and I see them very rarely.

But, I think I would have been very frustrated by ETech this year. It is still about the web. Achingly, still about the web. The problem is digital information and media is increasingly living beyond the web. The web is but one platform to distribute information, but thinking people live their lives in and on the web is silly. Want the information that is on the web, but need the information in their lives, in their devices they have with them, and in context to the rest of their life.

The panel that triggered this reaction is one by friends, Jesse and Jeff "Designing the Next Generation of Web Apps". In Tom Coates review the binary approach (web for reading and web for apps) sounds so short sited and really caused the trigger. Is Emerging Tech just rehashing the current and the past? Or can it move forward? I am not seeing much of that forward movement this year.

People live their lives attracting information and focussing on the Come to Me Web and Personal InfoCloud we know people need the information to better mesh into their personal digital information workflow, which involves very little of the web. People find the information that they want and need and work very hard to keep it attracted to themself for easy refindability. Other than social bookmarking tools and a few others web based tools, much of this is done with tools that are beyond the web. Some people tuck all of their needed information and links into e-mail, others calendar, to do lists, PIMs, text files, syndication, e-mail, SMS, MMS, documents, mobile syndication, mobile documents, outlines, wiki on a stick, etc. There are many tools and many ways of working around lack of web access when people need the information most.

Many people, unlike those of us that build web-based tools (I am in that category), don't live on the web and their digital information needs to live beyond the web as well. That is the future of the web, it is a platform for just one state of information. That state that the web represents is the state of information transience. The information is in the process of moving from the creator to the person needing that information for their own use or for their reuse. This use will most likely not be on the web, but the reuse of information may be on the web.

The web as it exists now is a tool for publishing and aggregating. Some will use the web for use and reuse, but we need far more options that the web for real people to adopt their future and our now. We, as developers of tools, information, and resources must pay attention to real people. We must pay attention to their lives beyond the web and the large box in front of them. We need to understand their problems that they really have, which revolve around refindability and information reuse in their environment and context.

Now please go back to paying careful attention to the great things that friends and other alpha geeks are presenting at ETech and other conferences and un-conferences as that information is needed, but remember we are moving beyond, far beyond this current state of the web.

[update] Um, well Ray Ozzie just made me wish I was at ETech. He just showed what is emergent and what is the future. It could answer many of the items I just listed above. You go Ray!

Yahoo! Go Launches [Updated]

I am quite interested in the newly launched Yahoo! Go, which is self described as:

Yahoo! Go - a new suite of products and services for your PC, mobile phone and even your TV.

Yahoo! Go allows you to access the information and content that is important to you on whatever device you choose.

So wherever you go, your photos, your music, your email, " your life&#quot; is right there with you. Ready to go.

The service provides your contacts (address book), photos, messanger, and mail. All great to have where ever you go. This is a very helpful service.

But wait! It is missing one thing. Yahoo! states, "allows you to access the information and content that is important to you". If that is true it is missing one giant piece. Where is the calendar? [Update] The calendar is actually there. Russ Beattie (of Yahoo! Mobile) provided the following response:

Y! Go also syncs the Calendar, it syncs with your Yahoo! Calendar and uses the Series 60 native calendar app on the phone for alerts. The SyncML service also syncs the calendar on phones like the SonyEricsson's and Nokias which support it.

What really impresses me is the SyncML work. That news is one of the most impressive things I have heard on calendaring in a while. I have been waiting for Apple to go this route for their iSync for the last couple revisions and I thought they would be the leaders on this syncing standards front. Yahoo! seems to understand the needs today and the future, which is one of the things that has impressed me about Yahoo! in the last year or two (they really get it, possibly better than any other large web company, yes I am considering Google too). If you want more info on Yahoo! and using SyncML Russ has the following post on Yahoo! Mobile Services: SyncML and More. I am still not sure why the marketing people left out calendaring. [/Update]

<ignore>Of all the things to leave out.</ignore> The calendar is one of two pieces of essential social data that people complain constantly that they do not have access to, or did not sync properly (the other is contact info). A large part of our social communication is about the "next". It could be the next call, the next meeting, the next lunch, the next... you fill-in the blank. Social is not completely about the now, it is about the future too. Not having a component to connect in the future and to ensure proper planning it is only a partial social tool.

One of my pet peeves the last four years, or so I have been working with the Model of Attraction and the Personal InfoCloud (your information you are interested, that you have attracted to your device, becomes attracted to you and moves across your devices so it is at your ready call when you want it and need it) is constant access to one's own information, which means whether you have connectivity or not and is available on the device you have with you (it must be device and platform agnostic). Yahoo! seems to get this all but for that one important bit.

In the past year Yahoo! purchased a company that provides event information (Upcoming), which could tie wonderfully into a calendar (either as events you are attending or potential events). Yahoo! also recently announced connecting Tivo and your Yahoo! calendar. We know they get the importance of the calendar. Where oh where is it? [Update] It is actually there just not advertised.[/Update]

BBC Knocks Audio Annotating Out of the Park

Tom Coates shows off the BBC's Annotatable Audio Project. Tom gave me a preview early on Saturday and I was ecstatic. You see, what the tool does is provide an interface to annotate and segment audio on the web. Yes, podcasts can be easily segmented and annotated. This has been my biggest complaint with podcasts over the past year, okay since they started getting big (that is big for an early early adopter). I complained to people I knew at Odeo about the problem and they said they were working on it. I mentioned this to podcast enthusiasts at Yahoo! about nine months to a year ago and they said if they did podcasting that would be one of the first things in it as it was a big complaint. Did they? No, they made a product not too indistinguishable from every other product out there? Where is the innovation?.

Why is this Huge

The reason I am so excited about this is voice/audio is not easily scannable, like type. I can not easily skip ahead in a 30 or 45 minute podcasts to find that which I am interested in. Many friends will forward me links to a podcasts stating I have to hear what somebody says. Finding that segment usually means listening to much of the whole podcast.

The other downside is if I hear something stellar in a podcast my mind will mull over that item for a little bit. This means the minute to five minutes that follow in the podcast are lost on me. This is not a problem with written materials as I can skim back through the content and pick-up where my mind drifted (it is usually in these moments of drifting that I find the best solutions to things that have bugging me - the Model of Attraction came out of one of these).

A couple other items of note about this product. It is great interface design as it is interactive helps the person using the product know exactly what they are doing. The second is the segmentation is a great asset. With segmentation I can easily see writing a script to grab items of interest (27 seconds for here and 36 seconds from there, etc.) and having an automated audio stream built for me. Not only do I have a personalized audio stream, but since the originals are annotated and I can keep track of where the information is extracted from I can easily point others to the spot so they (or I) at some later point can go back and listen to more so to get better context (personally I don't think people are against attribution, it is just that we have made it so hard to do so in the past).

Voice and Audio is a Common Problem

The last couple time I have travelled in the USA I have run across people quite similar to me. None of us like voice. We are not particularly fond of the phone, for much the same reasons as I have problems with podcasts. Too much information gets lost. In phone conversations I am often saying, "I am sorry can you repeat that", in part because I did not hear, but the something that was stated just triggered a good though process for me and I missed what came after that moment. (What would be a great application is Tivo for the phone.) I continually am running new ideas and thoughts through what I believe and see how they may change it. It is the examined life - I enjoy living.

So what Tom and his cohorts did was make podcasts and audio more usable. It makes it searchable. One thing that would be a very nice addition is to have those annotating the information each have their own distinct layer. Just like with folksonomies, the broad folksonomy where each individual and each annotation on a distinct element provides a richer understanding and richer layer. (Such things would be really nice in Wikipedia so that I could remove the people who I do not think add any value to entries (in not polite terms - those who I know are wrong and are polluting the value of Wikipedia, which is far too much noise for me on the entries I would love to point to), or conversely to use a "white hat" approach and subscribe to the annotations of people and the distinct tags or terms they use in annotations. I have many people whose opinions and view I value, but on rare occasions it is everything a person has to say.

Filtering information in a world of too much information to keep track of is a necessity. Filtering is a must. It is about time we got here.

Thank you Tom. I hope your new team can innovate as much as you were allowed at the BBC, which has been the most innovative large enterprise going.

Stitching our Lives Together

Not long ago Jeffrey Veen posted about Will you be my friend, which brought up some needs to better stitch together our own disperse information. An excellent example is:

For example, when I plan a trip, I try to find out who else will be around so I have people to hang out with. So my calendar should ask Upcoming.org, "Hey, Jeff says he's friends with Tim. Will he be in New York for GEL?"

This example would allow up to interact with our shared information in a manner that keeps it within our extended Personal InfoCloud (the Personal InfoCloud is the information we keep with us, is self-organized, and we have easy access to). Too many of the Web's resources where we store our information and that information's correlation to ourselves (Upcoming.org, LinkedIn, etc.) do not allow interactivity between online services. Some, like Upcoming and Hilton Hotels do provide standard calendaring downloads of the events and reservations you would like to track.

Some of this could be done with Web Services, were their standards for the interaction. Others require a common API, like a weblogging interface such as Flickr seems to use. The advent of wide usage of RSS feeds and RSS aggregators is really putting the user back in control of the information they would like to track. Too many sites have moved toward the portal model and failed (there are large volumes of accounts of failed portal attempts, where the sites should provide a feed of their information as it is a limited quantity). When users get asked about their lack of interest in a company's new portal they nearly always state, "I already have a portal where I aggregate my information". Most often these portals are ones like My Yahoo, MSN, or AOL. Many users state they have tried keeping more than one portal, but find they loose information very quickly and they can not remember, which portal holds what information.

It seems the companies that sell portal tools should rather focus on integration with existing portals. Currently Yahoo offers the an RSS feed aggregator. Yahoo is moving toward a one stop shopping for information for individuals. Yahoo also synchs with PDA, which is how many people keep their needed information close to themselves.

There are also those of us that prefer to be our own aggregators to information. We choose to structure our large volumes of information and the means to access that information. The down side of the person controlling the information is the lack of common APIs and accessible Web Services to permit the connecting of Upcoming to our calendar (it can already do this), with lists of known or stated friends and their interests.

This has been the dream of many of us for many years, but it always seems just around the corner. Now seems to be a good time to just make it happen. Now is good because there is growing adoption of standards and information that can be personally aggregated. Now is good because there are more and more services allowing us to categorize various bits of information about our lives. Now is good because we have the technology. Now is good because we are smart enough to make it happen.

Project Oxygen Still Alive

Project Oxygen has progressed quite well since we last looked in (Oxygen and Portolano - November 2001). Project Oxygen is a pervasive computing system that is enabled through handhelds. The system has the users information and media follow them on their network and uses hardware (video, speakers, computers, etc.) nearest the user to perform the needed or desired tasks. Project Oxygen also assists communication by setting the language of the voicemail to match the caller's known language. The site includes videos and many details.

Project Oxygen seems to rely on the local network's infrastructure rather than the person's own device. This creates a mix of Personal Info Cloud by using the personal device, but relies on the Local Info Cloud using the local network to extract information. The network also assists to find hardware and external media, but the user does not seem to have control over the information they have found. The user's own organization of the information is important for them so it is associated and categorized in a manner that is easy for them to recall and then reuse. When the user drifts away from the local network is their access to the information lost?

This project does seem to get an incredible amount of pervasive computing right. It would be great to work in an environment that was Project Oxygen enabled.

Tanya on Virtual Teams

Tanya offers up a wonderful brief discussion of virtual teams. This is a topic I really enjoy (I have products that I greatly favor (Groove and AIM/iChat) as it really helps productivity, but also the documentation process.

Udell presents the Personal Service-Oriented Architecture

Jon Udell discusses Your Personal Service-Oriented Architecture (SOA), which lays out the elements of the futuristic Apple Knowledge Navigator are actually available today, but with out the voice interaction. Jon points out that we already use search much like the navigator, but we are missing the ability to keep track of what we found valuable or not valuable from those searches that are related to similar searches the use ran in the past.

I really like this idea one's own Web browser will show you links you have followed before (within a limited amount of time), but these visited links and the metadata we add to this information does not easily transcend machines. I work on three or four machines through out a normal day as well as a few mobile devices. Each machine has bits and pieces of information strewn across them, but with only a little bit of it synched. This I would love to have worked out in the not so distant future. It takes some effort to get the information synching between the machines and devices (part of the Personal Info Cloud).

There are many gems in Jon's short article, including sharing information and searches with friends or "buddies".

Microsoft helps with Mac compatibility

Microsoft has put together a Mac and Microsoft compatibility site to answer questions and to provide assistance.

Understanding Open Source Development to help Public Policy and Management

In First Monday The Institutional Design of Open Source Programming: Implications for Addressing Complex Public Policy and Management Problems by Charles M. Schweik and Andrei Semenov. More simply put, what lessons can be derived from understanding the Open Source distributed methods that will help collaboration on intellectual issues, such as public policy, and understaning collaboration to better solve management issues. The physically distributed model is getting a test in many smaller organizations, including on information architecture non-profit that has recently opened its virtual doors.

Collaborate with iStorm

Color me interested iStorm is a Mac-based collaboration tool available for under $20 (including two years of upgrades). I am involved in more than one project that is running virtually and this tool seems what it takes to get the job done and more (yes, most of those collaborating are Mac users, but not every single one -- yet).

Cities of Ideas

Today's New York Times provides Creative Cities and Their New Elite, which theorizes that cities with higher than normal gay and bohemian populations are fertile grounds for economic sustainability, innovation, and technical growth. There seems to be a strong correlation between open accepting environments that recognize the importance of creativity and intelligence and the other measures of successful city cores that are economically viable. The article focuses on Robert Florida's "The Rise of the Creative Class: And How It's Transforming Work, Leisure, Community and Everyday Life", which fully fleshes out these discussions. The Austin American-Statesman expounds on the Cities of Ideas in their series. The core of growth is based on knowledge and ideas that provide the fuel for the local economy. The precept seems to account for the cities I truly enjoy, including Amsterdam and Paris.

Beeb also offers an insight into the Rocket Network, which is a collaboration tool that unites musicians virtually. The network lets artist collaborate anywhere in the world, but that is the same story for anything that touches the Internet.

Social life of paper

The Social Life of Paper has been linked by nearly everybody, but yet I could not find it. Ergo...