Off the Top: Reference Entries
Rebuilding My Note Taking and Management System and Model
The past many weeks I have been digging into a better note taking and management method, while also embracing what I have and my core underlying principles. A continual genre in YouTube I watch is around productivity, particularly around personal knowledge management methods and tools. A couple years back I ran into Zettelkasten Method, that comes from Niklas Luhmann, which focuses on his prolific reading and his card catalogue and related note taking system. Then a few months back I heard Jorge Arango’s interview with Beck Tench it drew Zettelkasten back into focus. The interview with Beck focussed on Tinderbox, which I love, but I also want mobile access to my notes from phone and tablet.
Early Exploration
I have been using Notion a little bit, but my only use the last few months is as an interstitial capture for YouTube and some other rich media. [I like Notion and it seems like a modern take on Podio and has a similar downfall of not sorting out an adaptive data structure for interoperability and consistency.] But, the communities that are interested in Notion became obsessed with Roam Research, so I looked at Roam. Roam and Notion are two vastly different approaches, which can complement each other but in to way replace each other. But, each has a similar faults, no API, no standard export for structured information, and fully cloud based. That is too many common failure points wrapped into one product (Notion is working on and API, which is really good). Roam bugged me most because it relies on an outline format but has no clue about OPML exporting, but worse has no good export model. The cloud based, which requires being connected and online is a model I really don’t like as, particularly if their isn’t a local sync nor standard data format model. What I really like about Roam is its block focussed format, that is akin to purple numbers model of small chunks that are addressable and reusable.
In this time of looking what a next generation of quick note taking would look like, but long used tool, NValt failed spectacularly, in that it would not find my directory where my 1,200+ notes were stored, nor could I add new notes. Fortunately all of my notes are in plain markdown text files, so all I was missing was my tagging of the files in NValt (Brett Terpstra who created NValt has been working on a new tool that can replace NValt but has been taking forever to show up and my need became immediate). This is one of the common reasons for owning my own notes and having them locally and not using somebody else’s model and framework. But, also using the [small apps loosely joined] model where many tools pointing at well formatted / structured data / information can function to their best ability and can use their strengths without breaking anything with the information / data.
Seriously Looking at Note Taking and Management Tools
I started looking at about five or six different note taking tools. I was building out a rough attribute model of tools to help see what each offered or didn’t. I am needing to write this up, but it started with watching Mike and Matty’s, Notion vs Roam vs Obsidian vs Remnote - How to best fit note taking app for you and using their criteria as a base, then building on it. Obsidian and Remnote were already on my list, but also included Zettelnote, Zettlr, and a couple that extended Tidlywiki for a Zettelkasten type model. I also included OmniOutliner as that has been (and will be) my core outlining tool that interplays well with OPML and I can back and forth with good mind mapping tools that also output and import OPML data standard. I also included DevonThink Pro as it is my long used (since 2005) note and information storage and smart search tool (it already was indexing my notes directories) that there is no chance I’m going to give up, but also knew it didn’t have the core functionality I was seeking, wiki-style back linking.
I did a quick test or Roam and ruled it out as it broke rules I try not to break, and it broke many of them (biggest one is know now you are going to exit before you enter anything and a lack of any structure nor API made it a giant risk I’ve been burned by too many times, but the developers have a lot of arrogance about their approach that far too often leads to disasters - sometimes the kindest, smartest, and solid planning people end up with disasters that I feel very badly about but arrogance and ignorant I don’t).
Zettlr and Remnote were next. But the setup took a bit more of me managing and building things and I know when I lose focus those may not be best choices for myself (my past self 15 years ago or more would have loved it and done well with it, but those days are not now).
Obsidian Ticks the Right Boxes and Adapts to My Existing Model
Obsidian is where I put some time. I pointed its “Vault” to my notes directory (and sub-directory) where I had my 1,200 markdown notes already (some of them were .txt extensions, which I did bulk extension swap on) and it could read everything perfectly. One of my first tests was adding backlinks to some of my social lenses and social scaling notes, which worked really well by making related elements connected. I started capturing my notes about what I was doing in Obsidian and the ease of not only connecting things with backlinks, but having the ability to set empty node wiki links (many notes with the same link to a note / page that doesn’t exist yet, but have the same link to it) and then being able to use backlink following from that non-existent notes link list of things pointing to it was insanely valuable.
I have quite a few book list and book note pages already and I started linking them and linking authors and making author pages. I also found I was wanting note page templates for simple book pages in a Zettelkasten model, a book notes template, author / creator template, and a few others. I created these from existing structured notes I’ve used for years and put the outlines in TextExpander using a simple input line or two to label all of the headers with author name or other name.
I started typing out my notes and highlights from books I’ve read and annotated over the years and after the first three or so books I was deeply hooked.
The Use Where Obsidian Showed I was Hooked
Where I knew I was sold was this last weekend I went back to one of Matt Webb’s blog posts on Small Groups that is dense and has links out to great resources. I captured my initial notes on Matt’s post, and annotated relating to his sections. But, I also quickly dug through the linked materials and created and filled out structured note pages for those as well. The James Mullholland post on Small Groups was fantastic and it spidered out to more related resources, so I followed those and took notes. All of this was cross-linked and back-linked and fleshed out small group notes that I have been building as part of social scaling I’ve been writing on and presenting (talks and workshops) for years. The small group size they focus on is roughly team size, but not a team. Both of these are cooperative social models, which scale from teams, groups (small to large groups with similar social interaction models, but the dynamics shift quite a bit around 75 people and break fully about 300 to 500 people), community (everybody inside a firewall or inside an walled off construct), and network (inside and outside a firewall - so for business it is customers, contractors, consultants, vendors, etc. where there needs to be a safe model for sharing information with shared goals as different roles with their purpose come together for back and forth exchange) - more can be found in my related write-up 5 Core Insights for Community Platforms Today.
This note taking and contextualizing and cross linking to rip through and gut a series of related and interrelated pieces has been something I’ve long looked for and wanted. Many dog years ago in college I took reading notes on note cards with citations and context. When writing a paper / essay I would assemble the note cards in an order that could tell a story. Then I would build an outline in WordStar and type in the quotes. Then I would write the narrative and wrapper. Obsidian is starting to get at that, but ripping through a resource to pull out highlights, quotes, annotations, and notes is utterly fantastic. It gives me a solid resource to easily pull together ideas and supporting information.
Other Obsidian Capabilities
Obsidian can show two note pages at once so to easily copy book citation information from the structured book note file into the book note page. The multiple notes in panels also works well for copying quotes to quote pages and cross linking.
Using Obsidian and Still Working from Mobile and Tablet
The mobile use essential had been broken for a bit after Dropbox stopped supporting softlinks in Mac and requiring that to be native in Dropbox and doing the softlink from the Mac to Dropbox. I moved the directory to Dropbox, which leaves a copy locally usable should something happen to Dropbox and added a softlink for local backups. I pointed DevonThink to this directory to index and I was back running. Now I can use Drafts to take a quick note from my iOS devices and push it to the notes directory (later go back and fix the file name) and I have good inbound notes and can use backlinks (which I test later). This method also works for share sheet to Drafts from Overcast or YouTube and having the link to the media and the notes all pulled in.
Happiness with notes has been missing for a while, perhaps happiness has returned.
Resources
The Data Journalism Handbook is Available
The Data Journalism Handbook is finally available online and soon as the book Data Journalism Handbook - from Amazon or The Data Journalism Handbook - from O’Reilly, which is quite exciting. Why you ask?
In the October of 2010 the Guardian in the UK posted a Data Journalism How To Guide that was fantastic. This was a great resource not only for data journalists, but for anybody who has interest in finding, gathering, assessing, and doing something with the data that is shared found in the world around us. These skill are not the sort of thing that many of us grew up with nor learned in school, nor are taught in most schools today (that is another giant problem). This tutorial taught me a few things that have been of great benefit and filled in gaps I had in my tool bag that was still mostly rusty and built using the tool set I picked up in the mid-90s in grad school in public policy analysis.
In the Fall of 2011 at MozFest in London many data journalist and others of like mind got together to share their knowledge. Out of this gathering was the realization and starting point for the handbook. Journalists are not typically those who have the deep data skills, but if they can learn (not a huge mound to climb) and have it made sensible and relatively easy in bite sized chunk the journalists will be better off.
All of us can benefit from this book in our own hands. Getting to the basics of how gather and think through data and the questions around it, all the way through how to graphically display that data is incredibly beneficial. I know many people who have contributed to this Handbook and think the world of their contributions. Skimming through the version that is one the web I can quickly see this is going to be an essential reference for all, not just journalists, nor bloggers, but for everybody. This could and likely should be the book used in classes in high schools and university information essentials taught first semester first year.
As If Had Read
The idea of a tag "As If Had Read" started as a riff off of riffs with David Weinberger at Reboot 2008 regarding the "to read" tag that is prevalent in many social bookmarking sites. But, the "as if had read" is not as tongue-in-cheek at the moment, but is a moment of ah ha!
I have been using DevonThink on my Mac for 5 or more years. It is a document, note, web page, and general content catch all that is easily searched. But, it also pulls out relevance to other items that it sees as relevant. The connections it makes are often quite impressive.
My Info Churning Patterns
I have promised for quite a few years that I would write-up how I work through my inbound content. This process changes a lot, but it is back to a settled state again (mostly). Going back 10 years or more I would go through my links page and check all of the links on it (it was 75 to 100 links at that point) to see if there was something new or of interest.
But, that changed to using a feedreader (I used and am back to using Net News Wire on Mac as it has the features I love and it is fast and I can skim 4x to 5x the content I can in Google Reader (interface and design matters)) to pull in 400 or more RSS feeds that I would triage. I would skim the new (bold) titles and skim the content in the reader, if it was of potential interest I open the link into a browser tab in the background and just churn through the skimming of the 1,000 to 1,400 new items each night. Then I would open the browser to read the tabs. At this stage I actually read the content and if part way through it I don't think it has current or future value I close the tab. But, in about 90 minutes I could triage through 1,200 to 1,400 new RSS feed items, get 30 to 70 potential items of value open in tabs in a browser, and get this down to a usual 5 to 12 items of current or future value. Yes, in 90 minutes (keeping focus to sort the out the chaff is essential). But, from this point I would blog or at least put these items into Delicious and/or Ma.gnolia or Yahoo MyWeb 2.0 (this service was insanely amazing and was years ahead of its time and I will write-up its value).
The volume and tools have changed over time. Today the same number of feeds (approximately 400) turn out 500 to 800 new items each day. I now post less to Delicious and opt for DevonThink for 25 to 40 items each day. I stopped using DevonThink (DT) and opted for Yojimbo and then Together.app as they had tagging and I could add my context (I found my own context had more value than DevonThink's contextual relevance engine). But, when DevonThink added tagging it became an optimal service and I added my archives from Together and now use DT a lot.
Relevance of As if Had Read
But, one of the things I have been finding is I can not only search within the content of items in DT, but I can quickly aggregate related items by tag (work projects, long writing projects, etc.). But, its incredible value is how it has changed my information triage and process. I am now taking those 30 to 40 tabs and doing a more in depth read, but only rarely reading the full content, unless it is current value is high or the content is compelling. I am acting on the content more quickly and putting it into DT. When I need to recall information I use the search to find content and then pull related content closer. I not only have the item I was seeking, but have other related content that adds depth and breath to a subject. My own personal recall of the content is enough to start a search that will find what I was seeking with relative ease. But, were I did a deeper skim read in the past I will now do a deeper read of the prime focus. My augmented recall with the brilliance of DevonThink works just as well as if I had read the content deeply the first time.
Paparazzi on Mac Fix-up
Since I upgraded to Apple's Mac Leopard I have had intermittent issues with Paparazzi for Mac, a webpage screen grab tool that will make an image of the full page. I am not sure what version I had, but am fairly sure it was still version 0.4.3 from my Tiger build. My issue was it would not render pages and would just stay blank.
In search of a remedy I went to the Paparazzi page and grabbed the 0.5 beta. When I loaded this on my MacBook Pro with Leopard 10.5.2 it the application would just crash. This was a step in the wrong direction.
One thing to keep in mind is I am a huge fan of Skitch, which I use for capturing sub-page elements. The ease of use, beauty in the interaction would make it really difficult for another tool to supplant the viewable screen grabs and sub-page screen grabs of Skitch. The freakishly ease of moving grabs and images out of Skitch into the apps and places I need to use the images and places I want and need to share them is unparalleled in any other application on any platform. So, I am looking for a full webpage screen grab tool
Call for Help on Twitter
I put a call out to friends on Twitter for an alternate resource. As is normal with Twitter I had a response with in minutes and many responses in 30 minutes. Jorge Arango made the great suggestion of using FireFox Extension - ScreenGrab, which I loaded and does a good job. Occasionally, I want to grab images of variances across many browsers, so I kept listening.
Another FireFox and Mozilla offering was surfaced by Joshua Porter of Page Saver by Pearl Crescent. The full paid version offers sub-page screen grabs, but it whole of the tool looks decent.
Nate Koechley stated his Paparazzi 0.4.3 was running just fine on his Leopard 10.5 and 10.5.2 installs. I went back to Paparazzi and grabbed the 0.4.3 install and used it to replace the 0.5 beta install. I started up Paparazzi and it ran just fine, just like it used to. The bugginess with my old install may have been that I had not recompiled Paparazzi to run under Leopard, which is what reloading essentially performed.
I am not one to always stop looking once I found what I was looking for (things are not always in the last place you look), so I listened to The Ronin and his suggestion for WebSnapper from Tasty Apps, which looks to be the next step up from Paparazzi with the breadth of output it offers. But, the downside is WebSnapper does not offer a preview of the output page as Paparazzi does.
The Result
It looks like Paparazzi (repaired) 0.4.3 will be my replacement for Paparazzi for pages it will deal with and WebSnapper will be its likely back-up. I hope that one day Skitch offers a full-page screen grab of web pages, but that day is not today. I am deeply appreciative of all those that offered their responses on Twitter.
Yahoo! Releases Web Developer Golden Nuggets
An e-mail from Nate tipped me off to the Yahoo! releases today. We now have at our finger tips, Yahoo! User Interface Library, the same libraries that power Yahoo! Yahoo! Design Patterns Library, which has been the culmination of a lot of effort and is considered to be the best internal resource around and is now in our hands. Yahoo! User Interface Blog and its corresponding Yahoo! User Interface Blog feeds. Lastly, Yahoo! delivers a Graded Browser Support (article).
Once again Yahoo! shows it gets community involvement with developers and is becoming a killer resource. This is the kind of involvement and giving that raises the level for all web developers. Bravo Yahoo! and thank you Nate for your involvement.
The World in Our Hands
SmartMobs announces It is official, there are more cellphones lines than landlines in the U.S.. I was thinking about this in the past couple weeks. We have already started seeing text and data uses tipping our mobile hands (it is about time we started getting to where much of the rest of the globe has already been).
Now if I could just keep my finger on the number of data enable phones and the lesser number of laptop/desktop internet connections for the globe. Every time I see this number I forget to mark it or grab it.
[Hat tip Anne]
Academic Cites for Interested Parties
One of the things that I am still mulling over that came out of the Social Software in the Academy Workshop is the relationship between academic cites and interested parties (non-academics researching, thinking deeply, and writing about a subject). Over the past year I have had some of the work I have posted on my web sites cited in academic papers. These papers have been for general coursework to graduate thesis.
In the academic realm these cites in other's works give credibility and ranking. In the realm of the professional or "interested party" these cites mean little (other than stroking one's ego). These cites do not translate to higher salary, but they may have some relationship to credibility in a subject area.
Another aspect is finding a way to tie into academic work around these subjects. There are often wonderful academic related gatherings (conferences, symposia, etc.) around these subject matters, but these are foreign to the "interested party". There is a chasm between academic and professional world that should be narrowed or at a minimum bridged in a better way. At SSAW there were some projects I found out about that I would love to follow, or even contribute to in some form (advisement, contributor, etc.).
I have a feeling I will be mulling this for some while, and will be writing about it again.
Flexibility in Folksonomies
Nick Mote posts his The New School of Ontologies essay, which is a nice overview of formal classification and folksonomies. The folksonomy is a good approach for bottom-up approach to information finding.
In Nick's paper I get quoted. I have cleaned up the quote that came out of an e-mail conversation. This quote pretty much summaries the many discussions I have had in the past couple months regarding folksonomies. Am I a great fan of the term? Not as much of a fan as what they are doing.
The problem of interest to me that folksonomies are solving is cross-discipline and cross-cultural access to information as well as non-hierarchical information structures. People call items different things depending on culture, discipline, and/or language. The folksonomy seems to be a way to find information based on what a person calls it. The network effect provides for more tagging of the information, which can be leveraged by those who have naming conventions that are divergent from the norm. The power law curve benefits the enculturated, but the tail of the curve also works for those out of the norm.
Webmonkey Comes Back To Life
Oddly, Webmonkey seems to have come back to life today. There is a new articles on Contribute2 dated June 18, 2004. Just below that is a note stating it is back alive and kicking (not dated). Anybody have the scoop?
CSS Cribsheet
I nearly forgot, Dave Shea has come up with a CSS cribsheet that flat out rocks. Dabbling or living in CSS? Use it.
Guide to Ethnography Wiki Lives
Peter Van Dijck relaunched Guide to Ethnography Wiki. This is a very good resource for understanding ethnographic studies and research.
Neal Stephenson's Quicksilver gets a referance site
My first edition copy of Neal Stephenson's Quicksilver arrived yesterday. I flipped through it yesterday and was very impressed with the craftsmanship of the book. The paper and typography are very impressive. I read the intro this morning and I am very much looking forward to digging in.
Also to note, Metaweb, an annotated reference for Quicksilver. The annotations are provided in part by Neal himself along with others. There is a need for this reference as this is a historical novel with fact and fiction interwoven. The reference provides a guide background and what is real.
Information Design Explained at Design Council
The Design Council has a fantastic overview of Information Design, written by Sue Walker and Linda Reynolds. This series covers why it is important to business and public service along with examples, challenges, where to find out more, and so much more.
IA at Xerox Parc
Inside the PARC: the 'information architects'. This is part of the Stanford Silicon Valley Archives.
UNIX and Mac OS X guide
I finally got my hands on a copy of Mac OS X Unleashed, which is a great resource. Not only does it provide indepth understanding of the Mac side of OS X, but it provides an excellent resource for the UNIX side too. I have had problems getting Perl's CPAN running through the "make" process for some modules. This book seems to give me enough understanding of the foundations to get me through the processes. I have knowledge of UNIX and Linux and each variant has its own twist, which is not a bad thing.Related to using the proper URL in the doctype, IE 6 renders table content as centered when wrapping the table with center tag. The article explains when this happens and how to work around the problem. One option is not using centering (either in a div align or in the deprecated center tag). It seems setting the CSS is the best work around. We have found using the center tag to be far more problematic than the div align usage of center. (Yes, we have to support "older" browsers at work).
Boxes and Arrows is finally live.
Digital Web is out with a new issue. My favorites from this issue are the interview with Chopping Block, the ever needed Flash usability guide, and the hands down my favorite is when design motivates. The rest of the issue is enjoyable and insightful as always, which includes motion design, the future, book review of 'Fresh Styles for Web Designers: Eye Candy from the Underground', and a review of digital video.
Digital Web Magazine has its fresh issue out. This month's focus is business, but also includes a solid review of HomeSite 5 and review of Web ReDesign: Workflow That Works, by Kelly Goto and Emily Cotler. This is wrapped in my favorite cover to date.
I really would like XP Home to have Samba (SMB) as the Apple documentation on using SMB to network machines and share drives is very solid. XP Home does not have SMB capability. If anybody knows a way to build it in plese e-mail me (comments being turned on this month or next month).
SMB is an open source networking tool that is supported on most operating systems. Windows 2000 and XP Professional support SMB. I should have learned my lesson and never by consumer grade software or hardware as I am always wanting to do more.