Knowledge Bases

Some time ago I started writing a whitepaper on the concept of knowledge management. It was never finished, for a number of reasons, and eventually the motivation for it disappeared. One of the problems I had with it was that whenever I sat down to write about one aspect the topic started to diverge and I ended up talking about something else. Not so good for a tight coherent whitepaper.

But exactly the sort of thing that appears in blogs. So why not explore some of the thoughts here?

The original incentive was a small application that my brother-in-law put together. The purpose, as far as I could tell, was to extract semantics from a digital artefact and hence more closely correlate items from multiple sources. One of the major intended uses was in targeted search. Of course, I may be a bit wrong on that since the descriptions I got were rarely so clear or concisely expressed.

At the same time our team at work were talking about how to induct new people into the fairly esoteric set of tools that we use. In particular how to make sure that key knowledge from our experts did not get lost as they moved on to other things. The company knowledge base is a useless tool which just collects scattered documents of all sorts and vaguely sorts them into general categories. Besides the team knowledge we had gathered was not generally applicable outside.

So how do you draw something meaningful from several hundred artefacts, of many different types. There were documents specific to a very narrow area and overview diagrams which purported to show the high level. Spreadsheets summarising the last twelve months and 100 slide packs which detailed yesterday’s status updates. All of which was essentially useless because it was not possible to find anything specific without talking to the person who put it there – if they remembered themselves.

So the ideas of what constituted a useful knowledge base were on my mind and I made several starts on covering off the key points that it should cover. The first of which is the critical role that searchability plays!

One other aspect is the actual definition of a knowledge base and why one would be useful. Obviously the purpose would drive the which aspects were most important and hence the design of any specific instance.

The best known and most readily available knowledge base is, of course, the internet itself. Almost anything you need to know is out there somewhere and there are a number of very clever people who have dedicated themselves to helping you find it. However the approach taken is to identify the pages (or pages) which most closely match the request.

What do you do when ALL the documents are at least tangentially related to the search topic, or when the information desired is scattered over a number of different artefacts. This is where a well designed knowledge base could be used.

DC or not DC

My previous article reminded me of something that has been on my mind in the past.
Electronic devices, ones that do very little mechanical work, generally operate best with DC power supplies. In mobile devices such as phones or notebooks, the input power is used to charge the battery and it is the battery which supplies the actual electronics. But even in a desktop computer there is an internal power supply which changes the input AC power into various DC voltages before passing it on to the different components.
This is obvious with devices which are charged through a transformer (technically a SMPS). The transformer is commonly a little black box on the power plug which makes it impossible to fit in the socket next to any other device (who designs these things?).
While ideally there is as little as 5% loss of energy in per device, it may actually be significantly higher. And each one is wasting power.
Now AC is supplied to homes because this is the most efficient way to transmit electricity over long distances. Devices which draw large amounts of power – such as whitegoods or power tools – also built make use of the full amount available. But smaller devices need to drop power to reduce it to usable levels and this basically wastes the energy as heat.
An alternative, hinted at above, would be to have a single transformer which converted the input supply to some standard DC voltage for use within the home. As car chargers are common amongst the devices in question, a 12V supply would seem to be appropriate.
It would even be fairly easy so set up such a system. All you need is a couple of car batteries, a trickle charger and a bank of sockets to plug in the device chargers. A competent electrician should be able to do it in an afternoon.
I imagine that the best option in most houses would be a single supply point where mobile devices could be charged, but there is no reason why multiple points could not be spread throughout the house. It would mean a secondary wiring job but DC is a lot easier to deal with than AC and the concept of twinned supply already exists with grey water systems.
Another extension to the concept would be to wire in solar panels (which naturally supply DC) so that the secondary system is fully self-contained.

Big battery

I just caught a news item about a town in Texas which is building the world’s biggest battery. The intent is to maintain power supply when the single line from the national grid goes out – as it regularly does.
Now I don’t know how much wastage there is in storing power in this way, but the idea is great from a theoretical point of view. The normal pattern for electricity is for a central point of supply with failure prone transport to the point of usage. The risk of failure in transport is (usually) mitigated by using multiple redundant pathways – the electricity grid. This mechanism fails in the case mentioned in the article because there is only the single line into the town.
There are several known problems with the standard way that power is supplied. One of the biggest is that the grid is built around large scale centralised feed-in to the network and storage is apparently not practical at that scale. Hence electricity is generated to match demand – increasing production as more is drawn from the grid and dropping when usage falls. The possibility (probability) of under or over supply is obvious.
Balance is managed by using several sorts of power generation, at least some of which can quickly and easily brought on- or off-line. Even petrol powered generator may be included occasionally to meet short term peaks. At the other end, power is shed (read wasted) when supply outstrips demand.
In other words load balancing is done with methods which are quite expensive from both monetary and environmental points of view.
Storing (relatively) cheaply generated power during slack times and drawing against high demand would seem to make a great deal of sense. I assume that this is not possible at the national scale and so cannot be used in the central power plants. Given the fact that a town-sized battery is such big news, I guess that even storing at the sub-station level would be difficult.
But let’s take the concept further; how about power storage at the street or house level? Could each office building, which already have maintenance staff, include some electrical storage mechanism?
There may be maintenance concerns around having a bank of batteries behind the switch-board in every property – especially since traditional technologies use a number of toxic chemicals. But battery technologies have progressed fairly far in the last decade, riding on the back of the green movement and electric cars. At the same time the environmental and financial drivers for such a strategy are becoming stronger.
The idea ties in very well with the local generation of power. The input to the storage device need not be the national grid, it could just as easily be solar panels or a wind turbine placed on top of the house.

Carbon Trading

There has been much discussion in the last few years about carbon dioxide and how to reduce emissions. I don’t want to talk about global warming or similar. To my mind reducing any sort of venting of any sort of waste is a good thing; whatever justification is used.
Australia’s response has been to introduce a framework for trading in carbon dioxide. Companies who vent are charged accordingly but given credits based on various factors (which I admit I have not bothered to understand). These credits can be traded to reduce or eliminate the amount that needs to be paid.
The idea is, of course, to artificially impose a market value on carbon and hence allow the normal economic forces to counter the drive to throw it away. The trouble with this is the unintended consequences which attend almost any attempt to use economic forces to drive anything.
The intended consequence is for the artificial costs of producing CO¬2 to be passed on to the consumer which, in theory will reduce demand. In many areas this will provide incentives for alternatives – even in areas such as power generation. However, there are so many other consequences that I suspect that the dynamics of the situation are likely to change completely. I will leave it to the economists to consider in detail.
However, one major point of concern is that this is an artificial market in carbon. Indeed the market is in a secondary resource – carbon emission credits. I would have thought that a better solution, although considerably more difficult, would be to create a real market in carbon. Who would vent a valuable commodity into the air if it could instead be sold to off-set production costs?
The underlying problem is not with CO2 production per se, but with the fact that it is vented to environment. Indeed this is the case with any pollutant: gaseous, particulate, solid or liquid. They are created because the most efficient industrial processes used to produce the enormous number of consumables we use also create large amounts of waste product as a side-effect. Disposal of the waste products is done in the most cost effective way – which often means just venting because capturing and/or storing them is often more expensive.
The problem here is the classification of substances as ‘waste’. One industry’s waste is another industry’s raw material. The point of carbon trading is to make the CO2 worth something so that it is traded instead of thrown away. But the value created is artificial – imposed by government regulation. But what if the gas had some real and tangible value as a raw material in some other industry?
Actually there are a number of industries whose waste product provides a raw material for some other industry. Connecting these production systems could (does?) provide a lucrative business for some entrepreneur.
This could be a prime area for some basic research – what can CO2 be profitably used for?
I am not an expert in this field and so I cannot answer that question myself but I would have thought that it was a ripe – over ripe – field of inquiry. Is there anyone in the world looking into it? I know it can be used to carbonate drinks, but I suspect that this will not use a great deal of the current world supply. I have heard of mechanisms of using C02 as a purifying agent – say for de-caffeinating coffee. Injected CO2 can be used to greatly enhance the strength of concrete. I can conceive of using it as a fuel or additive in cars – thus reducing petrol consumption at the same time.
CO2 is used to make dry ice – is this something that could be more extensively used in our society? Are there any other properties of the gas which may be useful? Could we fill our greenhouses with it – or at least increase the partial pressure a little (we don’t want to kill those people who work in greenhouses). Are there any medical uses? The possibilities are endless (mostly because I don’t know enough to discard them).
By providing funds to research agencies (most of which are government owned in Australia) to follow this chain of logic is likely to provide greater benefit for less outlay than the current approach. Of course, the approach is not restricted to carbon. Most major industries could profit from creating an alternate market for their own waste material. Even in obscure cases - waste heat from power generation need not be vented, especially when the power is, itself, going to be used to generate heat somewhere else. The trouble is in transporting the waste from the major industrial centres where it is generated to the places where it can profitably be used.
However, that is drifting off topic somewhat and I think I will explore another time.

Waiting for the Train

Standing on the platform,
Watching the last of the stars fade from the sky.
The scattered clouds painted with brilliant colour by the rising light
As the sun cranks itself up in the same direction as the arriving train.

My fellow commuters,
In clumps where the doors will be,
Huddled in black and grey,
Staring at the ground.

Words

Words are tricky things.
It is difficult to get them to say exactly what I want. Individual words carry connotations which vary not only with the person hearing them but also with the context and ideas which they have in mind at the time. Sentences (should) only carry a single thought and therefore ignore all the other inter-related aspects which impact on the underlying idea.
There is this whole mental construct with a myriad of implications and ramifications, multiple different aspects to be explored; and it can only be passed on through a single linear stream of variable symbols. Whatever is said, it leaves out so much and implicitly orders the remainder so that an unnatural prioritisation is applied.
Following one train of thought means neglecting all the other possible paths. But all facets are important to faithfully transmit the underlying concept. For anything but the most basic of ideas, what is communicated is, at best, a rough outline and at worst a completely distorted view.
There are, of course, other communication methods – most of which revolve around pictures or diagrams. These 2D mechanisms are better but can only be used in specific circumstances. But they are not generally useful in normal conversation.
Part of the purpose of this blog is for me to practice expressing complex concepts in this sort of linear fashion. When running an idea through my head I will often chase down the various chains and linkages to explore all sides of an idea. Where the idea came from, both in the context of why I am thinking it and conceptual pieces which compose it. The logical consequences and the other ideas that flow from it. The inter-relationships with other conceptual structures.
Trying to order all this in my head is difficult and can take some time – picking words and making connections to properly express the idea to myself. And when I have worked through it all and find the concept is fully formed, all these words and images are no longer necessary and the framework disappears. However then, for whatever reason, it becomes necessary to make someone else aware of the implications. The whole thought process needed to be re-constructed; preferably without all the false starts and doubling back.
What I am trying to do here is get the process done in appropriate words the first time so that I can avoid the re-work later. This does double duty of getting it out of my head so that I don’t keep running over the same old ground. However, the ideas that do occur to me are likely to be a fairly eclectic bunch since the driver for doing this is not so much the ideas themselves but the process.

Seeing broadly

I recently re-read one of Heinlein’s old books and came across a concept which obviously had caught his attention at the time. It has to do with a technique of training a person to be more attentive their environment and Heinlein referred to it as “Renshawing” after the creator.
Obviously the technique is not in common usage now (at least not that I have ever heard) but out of curiosity I looked it up in Wikipedia. Few of the training methods can be applied without specialised equipment, but there was one which required nothing other than your own eyes. It has to do with consciously noticing things that occur at the edge of your vision – cars passing as you walk past and store displays being the examples given.
Apparently this not only increases your awareness of your surroundings but may have a positive effect on your vision generally. Being of a ‘certain age’ I have noticed significant deterioration of my vision in the last couple of years. So, although some of the benefits sound a little implausible, I thought that I may as well try it occasionally. Especially since increasing awareness is supposed to be a significant factor in ‘luckiness’.
Of course, introducing any new habit, means actually remembering to follow it occasionally – often easier said than done. Remembering to perform some action, at least for me and in this sort of context, triggers a round of thought processes about the purpose of the action and especially why it might be something worth doing: creating a mental model about what it happening and the underlying basis for it.
All of which is a round about way of getting to a series of thoughts about how eyes are used. Being an office worker I spend a lot of time in front of a computer. This requires focussing on a small area of my full range of vision (about 50cm – or probably less – in diameter). Much of the rest of the time my gaze is focussed on a small area – a book, a face or similar.
There are few situations in a city dweller’s my world where a wide view is necessary. And there are so many extraneous details that tight focus is often advantageous. This sets up a positive reinforcement to the extent that people walking in the streets don’t notice anything happening around them; and the bigger the town the worse the effect. (I live in a small town and work in the city.)
As it comes to the end of summer I realise that sunglasses also contribute. There is a great deal of my field of view which is NOT covered. But in general use I don’t tend to notice this – I only see what is in front of me and therefore what can be seen through the lenses.
Obviously this is all the absolute opposite of the technique described above. I wonder what the constant tight focus is doing to both our vision and to our view of the world around us.