"When was the last time you were truly energized by ideas?"

The Cato University Home Study Course.

Not cheap but certainly valuable.

First Sign of the Apocalypse?

"Sun Microsystems Inc., once one of the most vociferous opponents of Microsoft Corp. and Windows, now plans to resell the operating system."

A Game-theoretic Framework for Creating Optimal SLA/Contract

Intriguing paper. Game theory is certainly a key tools of negotiations, conflict resolution, optimal cooperation problems, etc. Very interesting to see it applied in a practical manner to IT-related contracts.

Abstract: An SLA/Contract is an agreement between a client and a service provider. It specifies desired levels of service and penalties in case of default. It is of interest from the Service Providers point of view, to determine the optimal contract, that will maximize its utility. In this work we model the situation based on the notion of Moral Hazard: providing a good service is costly and results are affected by the resources involved. As a consequence, a credible contract must fulfill the incentive compatibility constraint. We extend the above model to take into account the possibility that there might different types of clients, and that the Service Provider will offer a menu of contracts intended for each of these clients, as a means of maximizing utility. From the Service Providers point of view, finding an optimal contract will consist of solving a nonlinear optimization problem subject to constraints. We derive conditions under which these constraints will take a simple form and we analyze a scenario, in which, the randomness comes from the Response Time of a given IT Service, and the input is the number of servers that will be dedicated to each client.

Reading List #6

I'm winding down from vacation so here's another Reading List comprised of three selections obtained from Sherman's Books & Stationary in Freeport, Maine:

Enjoy!

Reading List #5

During a lovely week relaxing in York Beach, Maine, the following books were either started or finished:

Enjoy!

'Sunk costs' and the war

University of San Francisco economics professor Bruce Wydick has an exceptionally clear op-ed piece in the 15 August 2007 issue of USA Today regarding America's involvement in the Iraq war.

It's Wikilicious!

The hype du jour is that a clever analysis tool for wikipedia entries and interesting/entertaining sources that edit/massacre/delete entries that pertain to themselves now exists.

* (I don't recall where I read this first today but to keep things on the up-and-up it was either Slashdot or Wired through my feed reader).

It seems that one can data-mine *.wikipedia.org via online search or download of a snapshot image with all previous edits, a la a useful audit trail. OK, that doesn't seem too interesting. Until...one looks at the sources of the edits and the effects and affects of these edits.

This is a perfect example, without drawing attention to myself, of the difference between data and information and the relation between the two. Data is available...it's up to individuals or processes to transform, and hopefully protect, it into information.

The New Age of Ignorance

As a follow-up to my last post concerning the systemic and intentional attempts to dissuade students from studying mathematics, I thought I would just offer a pointer to this, by way of the Edge, article from The Guardian:

The New Age of Ignorance

We take our young children to science museums, then as they get older we stop. In spite of threats like global warming and avian flu, most adults have very little understanding of how the world works.

Mathematics: Seriously, Just Say "No!"

In a previous post, I commented on a trend in the UK where students were being discouraged from taking "unnecessary," higher level mathematics classes. By way of Slashdot, it seems that is is an issue in Australia as well. The poster states and asks:

"The claim is that Australian schools are actively discouraging students from taking upper level math courses to boost their academic results on school league tables. How widespread is this phenomenon? Are schools taking similar measures in the US and Canada?"

I ask again: Will science education in the classroom be dead by the time my kids go to school?

Data v. Information

I had fun with a previous post regarding a data visualization tool called many eyes, from IBM alphaWorks Services. There are some nice graphing templates available but pretty graphs simply do not the wonderful experience make. OpenOffice CALC and Microsoft Excel can produce a multitude of graphs in a variety of canned formats but do they really assist in helping one understand the data being presented to them.

Are they capable though, as tools, to transform data into information? The distinction may or may not be a subtle but the implications are huge. We're generally over-run with data and consider so much of it to be throw-away. Information, however - information being data with some sort of context applied to it - one holds onto as long as possible because the context applied to the data, the transform or function applied to some data set, increases the data's value and elevates it to that of information.

Consider a couple of simple examples:

What does this string of data mean, if anything: 011903124555555

1. Well, it could be a random string of 16 digits and not very interesting (highly likely).
2. Out-of-country phone dialing number? (yes, US Embassy in Turkey)
3. Credit card number? (same format for Visa/MasterCard but not a valid number)
4. USPS/FedEx/UPS/DHL tracking number? (UPS if you drop their "1Z" prefix)
   
5. US social security number? (Massachusetts SSN with some cruft appended to the end).
6. Product SKU (I seem to recall that there are standardized SKU formats)
   

We just don't know, without any context applied to it. Now, what if we thought about another string of digits in the context of identity theft:

• 034011234,Last,First,Acct#

Huh...that looks important and maybe should be protected. Maybe it's a person with an account # and MA SSN on-record. The problem though, is that if the suspect data were changed to be:

• Acct#,034011234,Last,First

It could become meaningless because the transformation changed through simple re-ordering of data elements and the context may no longer be identifiable therefore leaving the data as data. There's a good chance, however, in this specific case that the context could be inferred. What happens if we eliminate the comma delimiters and just spew a line of text in the hope that it will be properly caught and processed?

• Acct#034011234LastFirst

Here we have an example where Acct# and SSN have been concatenated and probably lose meaning outside of the process that knows to stop reading the Acct# field after X characters and read the next nine characters as the SSN. First and last names can be extremely difficult to distinguish without capitalization and/or localized knowledge of standard names. Michael Smith may mean nothing to a non-English speaker.

So what does this mean from a practical point of view? Without waxing philosophical, from an information security and protection standpoint, it is an extremely compelling reason to give serious consideration to Translucent Databases, which I will post about at a future point in time.

Finally...A Use For Twitter

Until recently, I've found Twitter to be the single most annoying and useless fad since NeoPets and Tamagotchi toys. I still have absolutely no interest in, nor do I understand the fascination with virtual pets. I may be coming around to Twitter however.


The Lifehacker folks are atwitter for Twitter and using it as a productivity-boosting tool as opposed to a sort of micro-blogging platform:

Twitter is for staying in touch and keeping up with friends no matter where you are or what you’re doing. For some friends you might want instant mobile updates—for others, you can just check the web. Invite your friends to Twitter and decide how connected you want you to be.

I personally don't have much interest in what my friends or family are doing every second of the day or where they are at any arbitrary time when I am not in direct contact with them. Maybe I'm just stubborn and still prefer email, a telephone call, maybe some Blackberry love, or - heaven forbid - face-to-face interactions.

However, following two previous posts concerning access to interesting data sets and an interesting data visualization tool, I noticed My Mile Marker.

Being a bit of a data wonk, I immediately jumped onto the Twitter bandwagon so I could send SMS messages to M3 from the gas pump and fulfill my need for immediate gratification (which may seem like a strange thing when you're generating and collecting data for future analysis). M3 account creation was easier than easy.

M3 has a nice interface and provides some tracking and reporting tools.

I like this idea because I usually compute my fuel consumption when I fill my gas tank but it's nothing I track beyond each fill. I notice trends such as getting 50 fewer miles range per tank or averaging 2 MPG more than usual. I like the idea of viewing fuel consumption trends and identifying when, for example, I added air to the car's tires, changed the engine oil or the gas station began adding more ETOH as it gets colder in New England.

We'll see how this goes.

On Virtualization

Now, I don't know how far it has been considered in academia or industry but, excuse me if I am naive or simply unaware, virtualization, specifically paravirtualization, could be immensely useful to systems requiring a 1) minimal OS footprint with the ability to swap images in near-real-time, 2) an "online OS" or 3) an OS running on a virtual machine.

1. Set-top boxes such as (my favorite) the Moxi box or a TiVo could run multiple virtualized guest images, for the sake of a manufacturer upgrading feature sets or remediating flaws, over a consistent, hardened host image that only provides a bootstrapping facility the guest images. Through paravirtualization, presumably, hardware sharing and optimization functions, such as video capture and display/replay, could also be virtualized and provide for a transparent user experience as the various operating images are propagated to customers (presumably over multicast...I mean cable pay-per-view). Additionally, it could also offer rapid roll-back in the event of an image push and a call center flooded with complaints about set-top boxes that no longer work.


2. Ah, the "online OS." Everything Google does has an entire industry wondering if they are preparing for a browser-based, online OS. Browser-based with bootstrapping through a browser's existing JVM (or something similar)? Others are obviously thinking about this more topically than myself:
   

   
   "a bunch of startups like YouOS , Goowy, DesktopTwo, Xin and open source eyeOS are already tackling this exact problem"

   
   Maybe In a way, Sun is already doing it with their Sun Secure Global Desktop Software (wicked demo, BTW). Sun licensed Microsoft's Remote Desktop Protocol (RDP) technology in order to do some of this and the result is as smooth as a MS Terminal Services/RDP session but with dedicated, thin client hardware and a java-based smart card that allows a user to disconnect and later reconnect, at an arbitrary location, and have their last session in-place.


3. In a way, an arbitrary OS running on a virtual machine is sort of cool but mostly, "this is what virtualization is all about, slow to the table commentator." The Sun solution mentioned above can be considered in this light. Microsoft Terminal Services can use a thick client or browser-based end-user environment and still provide seamless connectivity.

So, I'm probably well behind the curve on this one as far as experimenting with the technologies but at least, to the uninitiated, there seem to be some useful implementation possibilities.

So You Say It's Your Birthday?

Today I am at the age where I:

• may not experience another birthday defined by the product of twin primes
• will not experience another birthday defined by the product of twin Mersenne primes
• will hopefully experience another birthday defined by the product of cousin primes
• probably will not experience the first three digit palindromic prime
• may not experience another birthday defined by the sum of n^th and n^th+1 primes

I'm not sure this trivia makes me any happier :(

Remember OpenDoc?

I stumbled on this hysterical spoof of the "I'm a Mac and I'm a PC" ads a while ago and nearly wet myself laughing. Almost everyone has an obligatory Newton reference when recalling great Apple ideas that were a bit too far ahead of their times. I'll skip the Newton reference and just start in with OpenDoc.

First off, Apple even seems a wee bit bitter when referencing their ideas and tech that never went anywhere. This is the best you can get from them on OpenDoc:

Reference Library

Legacy Technologies

Legacy documents consist of guides, references, sample code, and other resources that have become irrelevant for current product development. Some of these documents describe features, functions, classes, or methods that are no longer supported. Other legacy documents describe currently supported technologies, but the approaches and development techniques described in these documents are no longer recommended.

. . .

OpenDoc is a cross-platform technology that replaces conventional applications with user-assembled groups of software components. OpenDoc allows users to create virtually any kind of custom software solution. OpenDoc is not supported in Carbon.

OpenDoc met its end in a stand-off with Java that never really was a stand-off; they were complementary in the sense that you could develop OpenDoc objects in Java or what every language you preferred (Think C/C++ anyone?). Apple was having a bad day (OK, a series of years) financially, Java was the sweetheart of the internet du jour (second only to Helen) and Microsoft was first to market with OLE (object linking and embedding).

The true beauty of OpenDoc, IMO, was the ability to embed arbitrary objects into arbitrary "containers" as well as extending the container objects. Abstraction, encapsulation, inheritance, and polymorphism; traditional object-oriented topics, implemented well ahead of their time, as far as data formats are concerned.

The Palm Pilot (and its derivatives) was to the Newton as XML (and its extenstions) was to OpenDoc.

Microsoft Goes All Wishy-Washy?

Microsoft has historically been considered a rough-and-tumble company who chews up and spits out others firms like a lumberjack with a mouth full of tobacco. Three fairly recent instances however have me a bit confused about their image.

1. Microsoft claims Linux infringes on hundreds of its patents. The FOSS community goes bonkers. Microsoft refuses to state which patents have been infringed upon. Still no group hug to make up.
   
   So...Microsoft is emulating SCO but with a substantially larger legal war chest?


2. Via BetaNews, "In a policy document specifically timed for release this afternoon, Microsoft's general managers for interoperability, Tom Robertson and Jean Paoli, make a play for ownership of the standards issue facing users of competing document formats, by saying the company would support ratification of its own Open XML format along with OpenDocument Format (ODF) as ISO standards, if and only if doing so would promote choice among the world's consumers."

No comment here. I'm still miffed over Massachusetts gutting its CIO's power and appointing Brian Burke, a MS anti-ODF lobbyist to the Governor's Technology Advisory Group.


3. "Silverlight is a cross-browser, cross-platform plug-in for delivering the next generation of media experiences and rich interactive applications (RIAs) for the Web. The Silverlight 1.0 Beta has a go-live license that implies it can be used for commercial purposes."
   
   It implies it can be used for commercial purposes??? I was happy, however, to see the following on the installation page:
   
   "For Mozilla Firefox users:
   Save Silverlight.1.0beta.exe to your hard disk. Once the download is finished, click Open. The installation starts."

Fun With Data Visualization

My last post noted Data360.org and the impressive number of data sets they have available. I just stumbled on a new data visualization tool from IBM called many eyes so....

I grabbed an oil reserve data set from the US Energy Information Administration, by way of Data360.org, massaged it a bit in OpenOffice and fed it into many eyes. Click, click, click and you're provided with a pretty slick visualization.

Go. Go and play.

Fun Site for Data Wonks

Loads of fun. It's like Wikipedia for data and analysis.

Is 740 the new 520?

Recently, sub-prime mortgage lending has made the news amid fears that there may be as many as 2.2 million new forclosures in the US in the coming year. In the Boston Globe a while back, Thomas Callahan summarize:

"NOW THAT everyone is paying attention, let's review how we got here: Subprime loans became the mortgage flavor of the day several years ago. The worst kind of lenders preyed on the universal yearning for the American Dream -- homeownership -- and too often targeted African-Americans and Latinos with alluring, affordable, and ultimately deceptive sales pitches.

. . .

These are not just run-of-the-mill high cost loans. Subprime lenders keep coming up with new products and new gimmicks. That is why there has been a proliferation of 'stated income' loans and interest-only loans. These products have been around awhile but they had a limited use until brokers and mortgage companies started selling them to average consumers who didn't have a realistic chance of paying the mortgage."

In a way, sub-prime lending in the mortgage market is a bit like...like what? Let's construct a shady example that unfortunately, I've been told happens more often than it should.

A mortgage broker woos potential borrowers with wonderful terms and immediately flips the loan after closing it. OK, perhaps the broker over-sold to an under-qualified borrower but that's not their problem any longer. Nor is it their problem really when they out and out misrepresent a potential borrower. The result is a lender that now has an at greater risk borrower that it would have accepted otherwise. What to do? Flip the loan. This cycle can continue, based on other criteria as well, until the loan is paid-off or the borrower defaults. Musical chairs or hot potato with a large loan.

Excluding the boring case where the borrower pays the loan off in-full, without incident, the end result is a loan in default because a borrower was misrepresented to a lender. Most people still need to borrow in order to finance large purchases, such as houses. Sub-prime mortgage lending will continue to persist in some manner because of this; people need houses. Less than ideal borrowers will need to, in some way, boost their all-important credit scores since, no matter what anyone says, you are just a score.

There are positive financial incentives to every party involved except the unfortunate lender holding the note when the risk-deflated borrower defaults. Not knowing when or if that event will occur is the risk. If there was no risk involved, there would be no sub-prime lending markets; all borrowers would be identical. Since this is not the case, borrowers need to be differentiated in some manner and this will continue to be the credit score, for better or for worse.

The potential problem at hand then is the renormalization of misrepresented credit scores and how that could affect better borrowers and risk-adverse lenders. Borrowers that previously would not qualify for certain lending options would have their scores inflated in order to qualify. Typical borrowers would remain the same or possibly be a bit inflated as well. In other words, the typical ranges of credit scores would begin to contract while the upper bound would remain the same.

520 would be scaled to 720.

Recapitulation Theory and Second Life

Ontogeny recapitulates phylogeny

Internet Timeline: everything pre-Mosaic can be considered to be proto-web...extremely necessary from an evolutionary perspective but just not that sexy (like a caveman in a Speedo).

Second Life Timeline: in the beginning there was Real Life and it was fine but we got bored and started creating MUDs and MUSHes and the like but our kids thought we were weird until we installed SimCity for them so they would stay off our backs but it backfired and we ourselves became obsessed with Godzilla laying waste to our hard work for a few years until there was no reason to limit ourselves to simulating a city or life or an ant colony, no, we could simulate ourselves and everything we hoped and aspired to be and those around us in The Sims which taught us all how comfortable we could feel in drag or engaged in virtual infidelity or strafing a city block while trying to steal the helicopter...wait, wrong game, back up...all of this kept us satiated until we discovered (drum roll followed by hush)...Second Life.

Breathe...deeply...slowly...repeat....

So we have First Life (to those of us who think that art imitates life) and Second Life (to those of us who think that life imitates art). The internet as we know it slowly evolved until it reached a tipping point, i.e. the creation and release of the Mosaic web browser. After that, to many, it all went spiraling down the toilet, what with the massively increasing onslaught of spam, porn, commercialization of something that was pure, etc, etc, etc.

I don't completely agree nor disagree with the idea that the Internet has devolved into something crass and no longer meaningful. What I find terribly interesting, however, is the way in which SL is to a large extent, mimicking the evolution of the Internet as a whole.

Porn, rampant capitalism, porn, spam glorious spam, porn, activism and/or terrorism, porn....

So, is SL ontogeny to the Internet's phylogeny?

Why Is Gas So Freakin' Expensive?

Excellent essay describing the various forces at play regarding gasoline pricing (by way of the Freakonomics Blog).