vanderwal.net

Single Page PDF Option for Webpage Capture

Every now and then I get a bee in my bonnet about something. Often it is about something that has been long brewing. A current one, is PDF pagination. It is incredibly rare that I print anything. I regularly store / archive webpages in PDF, using DevonThink / DevonThink and for much more than a decade that PDF has been a “single page, continuous PDF”, which has no page breaks.

There is no reason (for the last 10+ years) to only offer multiple-page pagination for a PDF. It can be an option, but it’s driving need is the printer and rarely do PDFs get printed, as they are consumed on screens that we easily scroll.

A friend, Tantek, pointed me to Firefox (or derivative, a week ago I moved my work and research browser from Arc to Zen Browser to handle my spaces and capability to easily handle an abundance tabs) as it has good PDF capabilities built in. Firefox does have a lot of really good PDF tools (I deal with a lot of academic papers and related texts in PDFs). Firefox also has a full page screen capture, which is insanely helpful, which makes is really strange that there isn’t a similar single page PDF or “Print to PDF” option for one continuous page PDF capture of a web page.

Why Single-Continuous Page PDF?

Why is single page PDF such a need for me? Most of our interfaces around the web, or even our tablet note taking and beyond are one long page. PDF has long been, and still is, a great archive mechanism for holding onto and sharing things of interest that work across time. PDF is better than saving a web interface in its native form, as every 8 to 10 years there is a large enough change accreted that break web view files that are older and assemblages of components that they don’t consistently work in a browser. Having a colleague share their hand written notes from GoodNotes or Notability as a PDF often have pagination breaks in the middle of text, formulas, diagrams, etc. that have no need to be paginated at all. Most digital information and knowledge workflows don’t ever hit paper, nor have a need for multiple-page pagination. Multiple-page pagination as the only option is more than a decade outdate, but it seems only DevonThink offers a modern option by default.

Having the option and setting a preference for continuous single-page pagination printing to PDF (just like DevonThink has been doing for more than a decade) is needed in browsers and most of our digital applications. It is long past time to catch-up to this past decade, if not farther past.

Hiding Music in Plain Sight

As I was working on something today and had music going in the background I went to switch gears and I swore Apple Music had experienced a stroke and when I clicked to this song:

I clicked play and it fit the EDM style of music I appreciate and it sounded like an artist / DJ I liked, but couldn’t place it. But, I was deeply thrown by the type as it was well outside a Latin character set. Not only was the song and album in this outside the usual character set, but the artist name and label were too. I used the UI and clicked where I should be able to get the artists page in Apple Music and it was the same. But… the information about the artist unlocked it is Four Tet - Four Tet.

The downside is I don’t know how this is searchable, but a friend found a link to another Four Tet album that has used the same character set on the web. But, once I searched for Four Tet I found this Pitchfork review that explained much of of the “why” behind the characters - Pitchfork - Four Tet - Wingding - review. That led to finding it on Wikipedia Wingdings (album) - Wikipedia (James found it about the same time).

I loved the backstory and the reviews, but I still can’t freaking understand how to search for it easily. I have thrown it on a couple playlists, even started a new one with (so far) just it on the list.

Weeknote - 18 October 2020

Okay, that week was the prior week’s weeknote. Now I’m trying to capture two weeks in one. The prior week was rather busy and the weekend full too.

The morning coffee walk, this week turned a bit wet and chilly. I may need to change from wearing shorts for my this trek to get me out my door and a bit of exercise to start the day. Seasons and other temporal changes of worldly transitions have really flown past this year with little acknowledgement. The trees are just starting to turn in their autumnal color pageant, but it seems like they were just bare and bright green sprouts coming out.

I got a note this week from my webhost, which had been bought quite a while ago by GoDaddy and they finally said they are transitioning and my host is going away. I know a lot of people who work at GoDaddy and the leadership and inhumane leadership problems are gone. But, they are planning on moving from a hosting plan and platform I love that fits what I want to keep going (this site) and some small experimental spaces playing with Python, NodeJS small services, and a little Ruby and moving to a service that really isn’t clear about what it does, nor what it offers, nor pricing, nor service, and it is only based in the UK. With Brexit it is deeply unclear what is going on in the UK with regulation and anything and that is one of the last places I would want to have anything hosted.

So, some of my time will be focussed in the next couple or few weeks transitioning elsewhere. I think I know where, which is a hosting platform from former founders and employees of my current host. They have similar offerings, but I’m needing to sort out what these changes will entail for some of the custom pieces I have and dealing with email.

I was in the midst of starting to plan an upgrade to the underlying code of the site to bring it to a modern version of PHP. This is on hold until I get the site moved.

Read

There wasn’t a lot of reading time this week. But, I sort of parked An Absolutely Remarkable Thing for now as the micro-fame discussions were something that was causing a lot of self reflection around similar. I picked up John Green’s The Fault in Our Stars and just a few pages in I’m happy with the swap as John Green’s writing voice is one I find comfort in.

I’m also reading / skimming back through some Richard Feynman as some friends have stumbled on to it and has lead to interesting discussions. I read Six Easy Pieces around 2003 or so after writing the draft of Model of Attraction and as I fleshed it out and it turned into Complexity / Social Lenses there is a strong underpinning in physics through Feynman’s introduction, followed by discussions with good depth in physics and quantum underpinnings.

Watched

The Pete Souza documentary, The Way I See It about his time as White House photographer for Reagan and Obama. It was completely wonderful and a solid reminder of what a great leader does through understanding things deeply and supporting all others through leading with empathy.

Listened

Tigran Hamasyan is a musician I stumbled upon through a “what is this” explainer on YouTube, which lead to a mini deep dive. The two videos that had been deeply intrigued and really enjoying his music are IMPOSSIBLE Time Signature or 4/4? Tigran Hamasyan Explained and The Rhythms of Tigran Hamasyan on David Bruce’s channel, which I have enjoyed and stumbled on before. The cross over and different mental model using math transformations and mapping patterns through size relevance patterns that are adaptive is really intriguing.

Food

I don’t understand why sole, particularly Dover or Petrale, is so hard to find on the East Coast. I swear they were pretty much a year round fish growing up on the West Coast. This week I stumbled on a decent sale on Dover Sole so made a quick fry in virgin olive oil and brown butter, with a dry coating of corn starch, rice crumbles, sea salt, and black pepper then finishing with lemon and quick fried capers and pickled capers. This was a good Sunday brunch to say the least.

Productivity

In this transition from light too mid-term notes in NValt to Obsidian for better organization and cross-linking and an app that actually works (NValt stopped working spectacularly). One of the things I was peeved about was the tagging I had done in NValt. But, Brett Terpstra knows tagging well and tucked the tags in the user interface of NValt into the tag field in Apple’s file metadata. The one that I’m really wanting to get organized is my blogfodder tag, which is really rough drafts of posts, or collections of notes no a subject.

Late to Realizing Ovi Maps Does Exactly What I Wish

I been a big fan of Nokia's mapping solution built into its smart phones, Ovi Maps as it provides the best mobile turn by turn directions I've seen on any mobile device. But, this is largely because Nokia owns Navteq, which has long been the leader for on board mapping and driving solutions.

That FINALLY! Moment Reached

While I have been incredibly impressed with the Ovi mapping on my Nokia E72 device and often use the Ovi resources on the web, I hit that finally, somebody got this right moment with Ovi over the weekend. While, many web mapping solutions allow you to save favorites on the web getting those to sync to your mobile device, with your directions has been left out of most of these solutions (I have been complaining to friends at Google, Yahoo, and elsewhere for many years that this is a no-duh next step). Well, it seems Ovi figured this out quite a while back. (I noticed Google Mobile Maps provided this at the end of 2009, but have never been able to get it to work, even on my supported Symbian device.)

The simplicity and ease with with Nokia's Ovi pulls this off is rather stunning. With this aha moment, I feel like I was the last one to see this and sort it out, but in chats with other mobile maps and navigation users, they have been pained waiting for exactly this functionality, as most people it seems will get a location link and add it to their desktop maps (particularly for travel) but that does them little good as they don't take their desktop or open laptop into the car with them, they take their mobile. Understanding context of use is incredibly valuable.

Now may be a good time to check your device's capability, although iPhone does not seem to have this functionality supported by Google maps (surprised?).

Tale of Two Tunnels: Web 2.0 and Enterprise 2.0

Yesterday I made a few comments in Twitter that prompted a fair amount of questions and requests for more information. The quips I made were about the differences between Web 2.0 (yes, an ambiguous term) and Enterprise 2.0 (equally ambiguous term both for the definition of enterprise and the 2.0 bit). My comments were in response to Bruce Stewart's comment The whole "Enterprise 2.0" schtick is wearing thin, unless you've been monitoring real results. Otherwise you're just pumping technology.. In part I agree, but I am really seeing things still are really early in the emergence cycle and there is still much need for understanding of the social tools and the need for them, as well as how they fit in. There are many that are selling the tools as technologies with great promise. We have seen the magic pill continually pitched and bought through out the history of business tools. (For those new to the game or only been paying attention for the last 15 years, a huge hint, THERE IS NO MAGIC PILL).

Tale of 2 Tunnels

One comment I made yesterday is, "the difference between Web 2.0 and Enterprise 2.0 is like the difference building a tunnel through rock and tunnel under water".

That this is getting at is Web 2.0 takes work to build to get through the earth, but once built it can suffer from imperfections and still work well. The tunnel can crack and crumble a little, but still get used with diminished capacity. We can look at Facebook, which has a rather poor interface and still gets used. Twitter is another example of a Web 2.0 solution that has its structural deficiencies and outages, but it still used as well as still loved (their Fail Whale is on a t-shirt now and a badge of pride worn by loyal users).

The Enterprise 2.0 tunnel is built under water. This takes more engineering understanding, but it also requires more fault testing and assurances. A crack or crumbling of a tool inside an organization is not seen kindly and raises doubts around the viability of the tool. The shear volume of users inside an organization using these tools is orders of magnitude less than in the open consumer web world, but faults are more deadly.

The other important factor is perceived fear of the environment. Fewer people (by pure numbers - as the percentages are likely the same, more on this later) are fearful of tunnels through land, they may not have full faith in them, but they know that they will likely make it safely on all of their journeys. The tunnels under water have greater fears as one little crack can cause flooding and drowning quickly. Fears of use of social tools inside an organization is often quite similar, there may be many that are not fearful, but if you spend time talking to people in organizations not using tools (it is the majority at this point) they are fearful of open sharing as that could lead to trouble. People are not comfortable with the concept as they are foreign to it as they are lacking the conceptual models to let them think through it.

Enterprise 2.0 is not Web 2.0

Another statement yesterday that garnered a lot of feedback was, "Web 2.0 does not work well in enterprise, but the approaches and understandings of Web 2.0 modified for enterprise work really well." The web is not enterprise or smaller organizations for that matter. The open consumer web has different scale and needs than inside organizations and through their firewalls. A small percentage of people using the web can get an account on a tool have have appear to be wildly successful correctly claiming 70 million or 100 million people are or have used their tool. But, even 100 million people is a small percentage of people using the web. Looking at real usage and needs for those tools the numbers are really smaller. Most darlings of the Web 2.0 phase have fewer than 10 million users, which is about 5% of the open consumer web users in the United States. On the web a start-up is seen as successful with 500,000 users after a year or two and is likely to have the capability to be self sufficient at that level too. Granted there are many players in the same market niches on the web and the overall usage for link sharing and recommending for Digg, Mixx, or Reddit is much higher across the sum of these tools than in just one of these tools (obviously).

These percentages of adoption and use inside organizations can make executives nervous that their money is not reaching as many employees as they wish. The percentages that can be similar to the web's percentages of high single digit adoption rates to the teens is seen as something that really needs more thinking and consideration.

Enterprise 2.0 is more than just tools (see my Enterprise Social Tools: Components for Success for better understanding) as it also includes interface/interaction design for ease of use, sociality, and encouragement of use. The two biggest factors that are needed inside an organization that can receive less attention on the web are the sociality and encouragement of use.

Understanding sociality is incredibly important inside an organization as people are used to working in groups (often vertical in their hierarchy) that have been dictated to them for use. When the walls are broken down and people are self-finding others with similar interests and working horizontally and diagonally connecting and sharing with others and consuming the collective flows of information their comfortable walls of understanding are gone. A presentation in Copenhagen at Reboot on Freely Seeping Through the Walls of the Garden focussed just on this issue. This fear inside the enterprise is real. Much of the fear is driven by lacking conceptual models and understanding the value they will derive from using the tools and services. People need to know who the other people are that they are sharing with and what their motivations are (to some degree) before they have comfort in sharing themselves.

Encouraging use is also central to increased adoption inside organizations. Many organizations initial believe that Web 2.0 tools will take off and have great adoption inside an organization. But, this is not a "build it and they will come" scenario, even for the younger workers who are believed to love these tools and services and will not stay in a company that does not have them. The reality is the tools need selling their use, value derived from them, the conceptual models around what they do, and easing fears. Adoption rates grow far beyond the teen percentages in organizations that take time guiding people about the use of the tools and services. Those organizations that take the opportunity to continually sell the value and use for these tools they have in place get much higher adoption and continued engagement with the tools than those who do nothing and see what happens.

Gaps in Enterprise Tools

The last related statement was around the gaps in current and traditional enterprise tools. At the fantastic Jive Enterprise UI Summit in Aspen a few weeks ago there was a lot of discussion about enterprise tools, their UI, and ease of use for employees by the incredible collection of people at the event. One of the things that was shown was a killer path of use through a wide encompassing enterprise toolset that was well designed and presented by SAP's Dan Rosenberg who has done an incredible job of putting user experience and thinking through the needed workflows and uses of enterprise tools at the forefront of enterprise software planning. Given the excellent design and incredible amount of user experience thought that went into the tools behind the SAP toolset in the scenario (one of the best I have seen - functioning or blue sky demoed) there are still gaps. Part of this is identifying of gaps comes from traditional business thinking around formal processes and the tools ensure process adherence. But, the reality is the tools are quite often inflexible (I am not talking about SAP tools, but traditional enterprise tools in general), the cost of time and effort is beyond the gain for individuals to document and annotate all decisions and steps along the way. The hurdles to capture information and share it are often too large for capturing one to 10 quick sentences of information that can be retained for one's own benefit or shared with other where it is relevant.

There is another gap in business around the collective intelligence that is needed, which can lead to collaboration. Most businesses and their tools focus on collaboration and set groups, but at the same time wonder why they do not know what their company knows and knowledge is not all being captured. First there is a difference between collective and collaborative activities and the tools and design around and for those different activities is more than a nuance of semantics it is a huge barrier to capturing, sharing, and learning from information that leads to knowledge if it is not understood well. Enterprise has gone through its phases of knowledge management tools, from forms for capturing information, forums for sharing, and up to enterprise content management systems (ECM) that encompass document management, content management, knowledge management, and information harvesting. But, the gaps still exist.

These existing gaps are around conversations not being captured (the walls of the halls have no memory (well today they do not)) and increasingly the ubiquitous communication channel in organizations, e-mail, is being worked around. Quick decisions are not being documented as it is not enough for a document or worth completing a form. As the iterative processes of development, design, and solution engineering are happening at quicker and smaller increments the intelligence behind the decisions is not being captured or shared. This is largely because of the tools.

As has always been the case large enterprise systems are worked around through the use of smaller and more nimble solutions that augment the existing tools. Even in Dan's incredible demo I saw gaps for these tools. The quick tools that can fill these gaps are blogs, wikis, social bookmarking, tagging, Twitter type sharing, Veodia type video sharing, instant messaging, etc. There are many avenues to quickly capture information and understanding and share it. These tools get out of the way and allow what is in someone's head to get digitized and later structured by the individual themselves or other people whom have had the information shared with them in a community space. This turns into flows through streams that can be put into many contexts and needs as well as reused as needed.

Another point Dan stated at the Enterprise UI Summit that is dead on, is organizations are moving out of the vertical structures and moving to the horizontal. This is having a profound effect on the next generation of business tools and processes. This is also an area for Enterprise 2.0 tools as they easily open up the horizontal and diagonal prospects and tie into it the capability for easily understanding who these newly found people are in an organization through looking at their profiles, which eases their fears around sharing and unfamiliar environments as well as their related tasks.

[Comments are open and moderated at Tale of Two Tunnels: Web 2.0 and Enterprise 2.0 :: Personal InfoCloud]

Paparazzi on Mac Fix-up

Since I upgraded to Apple's Mac Leopard I have had intermittent issues with Paparazzi for Mac, a webpage screen grab tool that will make an image of the full page. I am not sure what version I had, but am fairly sure it was still version 0.4.3 from my Tiger build. My issue was it would not render pages and would just stay blank.

In search of a remedy I went to the Paparazzi page and grabbed the 0.5 beta. When I loaded this on my MacBook Pro with Leopard 10.5.2 it the application would just crash. This was a step in the wrong direction.

One thing to keep in mind is I am a huge fan of Skitch, which I use for capturing sub-page elements. The ease of use, beauty in the interaction would make it really difficult for another tool to supplant the viewable screen grabs and sub-page screen grabs of Skitch. The freakishly ease of moving grabs and images out of Skitch into the apps and places I need to use the images and places I want and need to share them is unparalleled in any other application on any platform. So, I am looking for a full webpage screen grab tool

Call for Help on Twitter

I put a call out to friends on Twitter for an alternate resource. As is normal with Twitter I had a response with in minutes and many responses in 30 minutes. Jorge Arango made the great suggestion of using FireFox Extension - ScreenGrab, which I loaded and does a good job. Occasionally, I want to grab images of variances across many browsers, so I kept listening.

Another FireFox and Mozilla offering was surfaced by Joshua Porter of Page Saver by Pearl Crescent. The full paid version offers sub-page screen grabs, but it whole of the tool looks decent.

Nate Koechley stated his Paparazzi 0.4.3 was running just fine on his Leopard 10.5 and 10.5.2 installs. I went back to Paparazzi and grabbed the 0.4.3 install and used it to replace the 0.5 beta install. I started up Paparazzi and it ran just fine, just like it used to. The bugginess with my old install may have been that I had not recompiled Paparazzi to run under Leopard, which is what reloading essentially performed.

I am not one to always stop looking once I found what I was looking for (things are not always in the last place you look), so I listened to The Ronin and his suggestion for WebSnapper from Tasty Apps, which looks to be the next step up from Paparazzi with the breadth of output it offers. But, the downside is WebSnapper does not offer a preview of the output page as Paparazzi does.

The Result

It looks like Paparazzi (repaired) 0.4.3 will be my replacement for Paparazzi for pages it will deal with and WebSnapper will be its likely back-up. I hope that one day Skitch offers a full-page screen grab of web pages, but that day is not today. I am deeply appreciative of all those that offered their responses on Twitter.

Ma.gnolia Goes Mobile

On Friday Ma.gnolia rolled out a mobile version of their site, M.gnolia - Mobile Ma.gnolia. This had me really excited as I now have access to my bookmarks in my pocket on my mobile. Ma.gnolia gives a quick preview in their blog post Ma.gnolia Blog: Flowers on the Go.

What Mobile Ma.gnolia Does and Does Not Do

First, off the mobile Ma.gnolia does not have easy bookmarking, which is not surprising given the state things in mobile browsers. I really do not see this as a huge downside. What I am head over heals happy about is access to my bookmarks (all 2800 plus). The mobile version allows searching through your own tags (if you are logged in). It currently has easy access to see that is newly bookmarked in Ma.gnolia groups you follow, your contact's bookmarks, popular bookmarks, your own tags, and your profile.

Mobile Site Bookmarks

One thing that is helpful for those that use mobile web browsing is having easy access to mobile versions of web sites. Yes, the iPhone and many smartphone users (I am in the Nokia camp with my well liked E61i) can easily browse and read regular web pages, but mobile optimized pages are quicker to load and have less clutter on a smaller screen. The iPhone, WebKit-based browsers (Nokia), Opera Mini, and other decent mobile web browsers all have eased mobile browsing use of regular webpages, but having a list of mobile versions is really nice.

Yesterday, Saturday, I created a Ma.gnolia Mobile Version Group so people can share web pages optimized for mobile devices (quicker/smaler downloads, smaller screens, less rich ads, etc.). One of the ways I was thinking people could use this is to find sites in this group then bookmark them for their own use with tags and organization that makes sense for themself. The aim is just to collect and share with others what you find helpful and valuable for yourself. This group will be monitored for spam as the rest of Ma.gnolia is (Ma.gnolia uses "rel="no-follow"" so there really is little value to spammers).

Ways You Can Use Mobile Ma.gnolia

This means if you tagged a store, restaurant, bar, transit site, or other item that has value when out walking around it is really nice to have quick access to it. It can also be a great way to read those items you have tagged "to read" (if you are a person that tags things in that manner) so you can read what you want in the doctor's office, bus, train, or wherever.

I have a lot of content I have bookmarked for locations I am work, live, and visit. When I come across something I want to remember (places to eat, drink, learn, hang, be entertained, etc.) I often dump them into the bookmarks. But, getting to this information has been painful from a mobile in the past. I am now starting to go back to things I have tagged with locations and add a "togo" tag so they are easier for me to find and use in the Ma.gnolia mobile interface. I have already added a bookmark for an museum exhibit that I really want to see that is not far from where I am. When a meeting is dropped, postponed, or runs short near the museum I can make a trip over and see it. There is so much information flowing through my devices and it is nice to be able to better use this info across my Personal InfoCloud in my trusted devices I have with me and use the information in context it is well suited for, when have stepped away from my desk or laptop.

I am looking forward to see where this goes. Bravo and deep thanks to the Larry and others at Ma.gnolia that made this happen!

Ma.gnolia Portable Social Networking Group Now Open

I have been talking with people about portable social networks for 18 months or more and initially blogged about it last November (2006) in my post Following Friends Across Walled Gardens. Recently the portable social network effort has flowed into Microformats: Social Network Portability. I have been following Brian Oberkirk's portable social network blog posts and we have had more than a few chats about this in the last few months. Finally it seems that some core geeks are on this quest as well, thanks to a gathering of minds at Foo Camp with Brad Fitzpatrick and David Recordon posting Thoughts on the Social Graph and the starting of the Social Network Portability Google Group. The oauth (more info on OpenAuth). Kevin Lawver has been rocking the real world with his Portable Social Networks at Mashup Camp discussion and example.

Ma.gnolia Portable Social Network Group

Tracking these small bits that are loosely joined needed a little more glue. To this end I started a ma.gnolia group for portable social networking to aggregate links. Already there is a good groups of people joining the group, which is promising. I have been critical of Ma.gnolia in the past, but they have iterated and built a social bookmarking site that has become my favorite social bookmarking service (Clipmarks is my second favorite when I need to just hold onto sub-page items). If you want to keep follow, keep track of the current site, or (even better) contribute bookmarks as well as join in discussion join the group. Ma.gnolia makes joining insanely simple by using OpenID for account creation and login (should you be part of the modern web world - such as having an AOL AIM account).

New Profession Unfolding In Beauty and Geekery

A week or more ago I ran across the incredible video of Blaise Aguera y Arcas presentation of Photosynth and Seadragon at TEDTalks 2007. The video is stunning work of Seadragon and Photosynth bringing a collection of images to life from one or more resources.

While the video and ideas behind the tools are incredible displays of where we are today with technology and where we are heading, this caused some ideas I have been trying to get to gel to finally come together. In this video Blaise states (my own transcription):

So what the point here really is, is we can do things with the social environment taking data from everybody, from the entire collective memory of what the earth looks like, and link all of that together and make something emergent that is greater than the sum of the parts. You have a model that emerges of the entire earth, think of it as the long tail to Stephen Lawlers Virtual Earth work. This is something that grows in complexity as people use it and whose benefits become greater to the users as they use it. Their own photos are getting tagged with metadata that somebody else entered. If somebody bothered to tag all of these saints and say who they all are, then my photo of the Notre Dame Cathedral suddenly gets enriched with all of that data. I can use it as an entry point to dive into that space in that metaverse, using everybody else's photos, and do a cross-modal and cross-user social experience that way. Of course a by product of all of that is an immensely rich virtual models of every interesting part of the earth, collected not just from overhead flight and satellite images, but from the collective memory.

Torrent of Human Contributed Digital Content

What this brought together was the incredible amount of human contributed digital content we are sitting on top of at this moment in time. This is not a new concept, but what is different is the skills, tools, and understanding to make use and sense of all this content are having to change incredibly. The Photosynth team is making use of Flickr content that has been annotated by humans (tags, titles, and descriptions), as well as by devices (date, time, location, etc.). This meta information provides hooks put pull disparate information back from its sole beauty and make an even greater beauty and deeper understanding. The collective is better than the pieces, but pulling to collective together in a manner that is coherent, adds value, and brings deeper appreciation is where get hard.

Much of information understanding and sense making to date has relied on human understanding and we have used tools to augment our understanding. But, we now need to rely on deeper analytics in quantitative methods and advanced algorithms to make sense and beauty out of the bits and bytes. The models of understanding are changing to requiring visualizations methods (much like those of Stamen Design) to begin to grasp and see what is happening in our torrent of information at our finger tips and well as make sense of the social interactions of our digitally networked and digitally augmented lives.

Amalgamation of Designer and Quant Geek

What gelled in my mind watching the Blaise demonstration is there is a skill set missing in the next generation comprised of amalgamated design, information use, analytical foundation, and strong quantitative skills. I have clients in start-up businesses and in enterprise that are confronting these floods of information they need to make sense of from folksonomies and customer generated content (including annotations and regular feedback). The skills needed for building taxonomies are not translating well when the volume of information the information managers are dealing with is orders of magnitude higher than what they dealt with previously. The designer, information architect, and taxonomist who have traditionally have dealt with building the systems of information order, access, and use are missing the quantitative skills to analyze and make sense out of a torrent of loosely structured information and digital objects. Those with the quantitative and strong analytical skills have lacked the design and art skills to bring the understanding into frame for regular people grasp and understand.

This class of designer and quant geek is much like the renaissance men, but today the field of those forging new ground is open to men and women. The need to understand not only broad but deep sets of data and information so to contextualize it into understanding is the realm of few, unfortunately as there is a need for many.

I know of limited pockets of people with the skills to do the hard work of querying the vast array of information, objects, and raw data then make something of value of it. But, there needs to be more of these people getting trained as designers with solid quantitative and analytical skills (or the converse). Design shops are missing the quant geeks and engineering shops are missing the visualization geeks that bring this digital world rich in opportunity into something that makes sense and beauty.

If you know people like this that are bored, please let me know as I am finding opportunities flowing.

From the HQ Office

It has been a good stretch of travel, mostly for work/professional life, but also took a trip to Florida for family holiday. At the moment I am back in the office working on proposals for upcoming projects of various lengths for clients and working through the process of writing, which involves dead trees at the final stages.

Web 2.0 Expo and SF Bay Area

I am soon off again to the San Francisco Bay Area to speak at the O'Reilly Web 2.0 Expo and have business meetings around the Bay Area (please ping via e-mail if you would like to meet-up during this time).

WWW2007 Workshop on Tagging and Metadata

Early next month I am off to Banff to keynote the WWW2007 Workshop on Tagging and Metadata for Social Information Organization. I am not sure how long this trip will be as I will have some pressing work around this time.

Social Software Summit

Lastly, I should note there will be a Social Software Summit that will run at the same time as the ASIS&T IA Summit next Spring (Spring 2008) in Miami. The Social Software Summit is still in its early stages of planning (the idea, dates, location, and interest have been launched). The dates are April 10-11 2008. I have a role in the planning and preparation for this event, along with some other incredible people.

The Merlin Show interview with John Vanderslice

Yowza! The Merlin Show interview with John Vanderslice is fantastic. The discussion about changes in old media, marketing, music, DRM, and the state of the music industry is fantastic. John is smart and understands the marketplace and how to make money. How to make good money.

I am completely enjoying The Merlin Show with Marlin Mann. I am not a huge fan of podcast nor video podcasts due to the attention and time they take. I do have a stack of them backlogged that I will get to the day the Internet is gone for good, but Merlin is keeping me drawn in when I can't sit down and chat with him in person.

Love ya Merlin, keep up the killer work!

New Podcast Interview of Thomas Vander Wal by Brian Oberkirch

I have been slow in pointing to a recent Podcast interview of Thomas Vander Wal by Brian Oberkirch. Brian and I have been trying to schedule this chat for quite some time. We cover a broad range of subjects that are of interest to me and I have been thinking about and playing with lately.

Brian has a great collection of podcasts interviews from his edgework series. I have listened to many and really enjoy them.

Domain of Digital Design Includes Strings

Many of us around the digital design profession consider visual pixels our domain, information as content and its structure is our in our domain, and the ease of use as part of our domain (all of this depending on what label or design community we align with). Strings do not fall into the design camp. By strings I mean data strings, which include date stamps, URLs, identity strings, etc. These often fall through the cracks.

In the last year or so these have become quite important to me as I look at the URLs on this site (vanderwal.net) and they are not as friendly, readable, or guessable as they should be. There is no understanding what http://www.vanderwal.net/random/entrysel.php?blog=1862 will lead to. Do people actually care about this?

Attention to Strings

I find not everybody cares about data strings, but some people do and many devices and services do too. We know many people do not pay attention to their address bar when surfing the web, but when they copy a link to send to a friend or IM a friend, they often look at the URL as a double-check. This is where confusion comes in, they have no idea that blog=1862 is the post they are wanting to share and it takes them out of a simple flow if they want to make sure it is the right thing.

Not only do people care by devices and services care about what is in strings. When a site is scraped by a search engine one of the important components in weighing the validity is the words in the string. If "blog=1862" were some thing that I wanted to ensure had optimal opportunity to surface in any of the major search engines I would want to ensure some key terms were in the URL that was being scraped and used. To the search engines 1862 means very little.

Human Readable

The goal is to have these data strings human readable, which leads to text that machines can read and used in algorithmic and automated filters and optimization tools. Not only do URLs need help, but so do date strings. Date strings should be easily understood and they should be labeled with relevant time zone if time is displayed as well.

Ground Control to Major Thomas - Where Are You

Again I turn to my own blog and its less than optimal state of being for my fodder. Since Fall of last year my vanderwal.net site has been hosted in Australia (a wonderful hosting company Segment Publishing (SegPub)). Part of this means that my time stamp for posting my blog entries grabs the local date and time. Since last Fall I have been blogging from the future, or so readers have been thinking. In a couple weeks I may actually be blogging from a the local timezone for my blog, but it is something I need to change.

One complication I have is I post content from various timezones. I could make all dates local to where I post, or choose the Greenwich Mean Time (GMT) as a default and label it properly as such. One of the things that the date and time stamp for posts does get mostly right is it is understandable. Many times we see sites with the tech generic "2006-7-23T2:44:03Z" rather than a more easily human readable "7 July 2006 2:44:03AM GMT".

Data Strings Design Worthy Too

I hope these examples from my own site (a self-built blogging tool that I have not touched much since 2001 or 2002, which I use but not fix or move away from) help illustrate the confusion unattended to date strings play. If we care about the experience for people coming to our sites we build and design we need to care about the little things, the details, like URLs and date strings.

[Yes, I will fix my site eventually. I have been waiting for that magical downtime to sort through porting all my posts and related metadata into a real blogging tool, as I really do not see me finding the time or desire to start tackling all that I want and need to fix in my own dear little tool.]

The Tension of Sharing

In today's culture there is a serious tension between creative types, publishers & owner of rights, and other creative types. Society and culture has traditionally been handed down through generations and each innovation is built upon. Today we are living in a world that is trying to monetize this sharing and handing from one creator to another, which is placing money as a higher value than advancing culture and society. Today in the New York Times the latest iteration of the clamping down is presented in the article, Now the Music Industry Wants Guitarists to Stop Sharing, which is about sharing guitar tabs online.

We Can Advance Culture and Society Faster Today Than Ever Before

This sharing of guitar tabs has always been around, as has sharing most other music insights from one musician to another. This sharing is how nearly all of us have learned, embraced, and improved our skills. Not only do musicians learn this way, just as they always have, but it also how designers learn and share. The web not only made this quicker and easier, but web designers and developers have always been able to peek at the under pinnings of each others markup and design. This sharing helped move the web along more quickly than many technologies and mediums that came before it. The web is built on a creative culture mindset of free sharing. Part of this extension is nearly all creative cultures have advanced in recent years because of the web. Creativity has been democratized and the ability to get from zero to 7 is made very easy. It has been a time of immense innovation and a vast spreading of innovation.

One of the odd things is the corporate culture, which does not move at as fast of a pace (look at the ironic juxtaposition of Microsoft, which enabled innovation and was incredibly innovative, often by using the innovation of others (bought or "borrowed") is not a big corporation that is very slow moving and more reactive than innovative (on a whole, as I do realize there are some incredibly innovative segments inside Microsoft - particularly in the Live area and things that Ray Ozzie touches). It is the corporate culture of those that do not create but try and "own" what is the result of the creative process that are trying to stand in the way of traditional sharing in society and culture. It is ironic that what they spend their time suing to inhibit is what created the items of value they are claiming they are protecting.

Creativity Needs Sharing and It will Find Ways Around Control

There are many ironies in the top-down control industry, in that they are trying to kill what makes them money. The RIAA has tried to kill peer-to-peer sharing, but with the horrible state of radio the best way to learn about new music is to use peer-to-peer services. Recent studies show nearly all of the music on in iTunes and iPods is actually owned by the person using that device. Research around how people find the music they purchase points to open sharing of that music. That is how I do it and many of the others that I know.

Let me illustrate... Recently I ran across a Steely Dan making of Peg video on YouTube, which I really enjoyed. It was about the deep geek side of musicians sharing how they recorded and produced their hit song Peg. They were sharing their secrets, for a small price. But in this instance it was free on YouTube. I doubt that Steely Dan or anybody related to the DVD that this video came from authorized its use. But, because of watching the YouTube segment I bought the Steely Dan Aja DVD. I would have never known about it had I not run across the sample on YouTube. Not only did I buy it but in my circle of friends I know seven others that did the exact same thing, watched it on YouTube and then bought it.

This is a story of free sharing about musicians sharing their craft with others so to improve upon the whole of the craft. This is the thing that the New York Times article highlights as being a problem. But, it is the corporations around creativity that have put a noose around their prospective industries by getting their friends in U.S. Congress to regulate sharing and creativity and make it a crime in the Digital Millenium Copyright Act (PDF).

I am finding that much of the music I enjoy is not coming out of the corporations, but the creators and innovators who are connecting with their audience directly. Last evening I watched a video on YouTube that we are interested in picking up. I clicked a little bit on YouTube and discovered The Dualers from London, who I am quite impressed with. The Dualers are a ska/raggae duo/band who do not have backing of a record company, but made it into the pop charts in 2004 and stayed there for a bit. Ska/raggae is a type of music that is out of fashion with the record companies, but still has a large following. It is music that still resonates not too far out in the long tail. YouTube is one of the means that The Dualers promote their works. They have sold over 35,000 CDs, which is atleast $350,000 if they are sold for $10 a pop, which would be much better than a deal a record company could offer them starting out.

How to Ease the Tension?

A large part of fixing the current problem is fixing the laws and getting people in upper management and in control of the media companies organization that litigate rather than adapt. We need to return to embracing creativity and sharing. We need to do this in a manner that creators can make a living, which may include cutting back on the role of the middle men. I see a shift toward media outlets that can innovate, iterate, and help support the creators as well as support the media outlets. The radio industry is in serious trouble in its current iteration and may need to move to a more segmented and broader distribution like XM and/or Yahoo Music and LastFM and MySpace as social means of finding new music and connecting directly with bands/creators.

I have been quite interested in some of the stories about EMI and how they have added value, creativity, and innovation for Gorillaz and even Coldplay. It seems that EMI pays attention to the community and lets the artists connect with their audience, which then helps shape their music and creativity. This sounds like the smart leadership that is needed. I have only heard these stories anecdotally, so I am not sure how much is really done by the community with interest or the artists. But, I can hope.

Are We There Yet? - The Need to Easily Shift Medium

People & Medium Preferences

Talking to people about the peeves about the flood of information they deal with in their lives there is a trend that seems completely unaddressed. This is the understanding that people have preferences for voice, text, and/or media. If you leave a text person an voicemail they do not process it well. IMing a voice person will frustrate them.

Medium Is the Attractor

I am ever more sure Marshall McLuhan is as valid as ever with his maxim, "The Medium is the Message". But, more importantly the medium is the attractor (or detractor). The voice people love other voice people and tend to ignore text people and their text attempts to interact with them and visa versa. Text people tend not to get into podcasts. When using news sites text people get frustrated with no text version of a video and media people like video over text.

Closing the Gap?

What needs to be done to fix this? I have not seen easy voice to text and text to voice solutions pop-up that will solve the message leaving problems to match information consumption preferences. There are tools out there, but they are not filling into the mainstream and not easily integrated into the tools people regularly use.

The solution for content creators is to provide more than one medium. I keep hearing complaints from friends and others in airports (my favorite place to interact with regular people) about CNN only having text or video versions of their stories and not both side-by-side. It seems like CNN is making a lot of changes lately, so hopefully this will get resolved (as well as their videos not playing on Mac easily, or PCs for that matter if the airport population of regular people is any indicator).