Nutch and Lucene

We have been wanting a search engine at work for some time now so I started looking at Lucene. I downloaded it and got it running and doing some basic stuff but what we really wanted was something web based, ie an out of the box solution.
I suggested we try Nutch, so I spent today getting it running. Nutch itself is a piece of cake to get working, what wasn’t so easy was getting Tomcat4 working with Nutch.
After much swearing and perspiration I finally manged to get it working and it is as sweet as a nut. We indexed just over 200 word documents in a few minutes (test machine is an old celeron) and gave it a whirl. Straight out of the box solution to your search engine problems. I was very impressed. I may have more to report on this next week because we might be putting it on one of the larger servers for a trial run.

ICANN & IWILL

What planet are ICANN transmitting from!
They have decided to change the policy on transfering domains ie if you are unable to respond to the transfer request and deny it withing 5 days the transfer goes ahead. What does this mean and why is it bad.
I am the sole contact for all of my domains which means if I was on holiday and someone initiates a transfer request and I don’t respond which I won’t because I am on Holiday I get back home and my domain has been given to somone else. The same thing would happen if I was in hospital. For those non techs out there the following is a good analogy.
You decide you would like to rent in London so you have a look around and get yourself a nice property and sign a contract for 2 years with a first option to extend if you want. You pay your deposit and move in. Its great people learn where you live they know where to find you and your little falt becomes prime location. Having the option to always rent this flat is also great because you want to stay.
Then one day you go on holiday and someone who wanted the flat decides to move in, under current rules they cannot. Under new rules if they knock the door and there is no reply for fives days they are able to break the lock and move in.
So when you get back someone has moved into the flat you spent so much time on and there is not a thing you could do because you didn’t answer the door.
This is absolute nonsense and I can only assume ICANN are doing it because there is some way to make some money from all the court cases which are going to appear when the fraudsters start trying to snatch domains that they shouldn’t have.
Luckily for me I use 123-reg.co.uk which posted me the following today:
Dear Customer,
On 12th November ICANN will introduce a new policy designed to make
transfers of non-UK domain names between Registrars quicker and easier.
From this date, if there is no acknowledgement from the domain
owner/admin contact within 5 days of a transfer request being made, the
transfer will automatically take place.
While a great step forward in ensuring domains can be freely
transferred by their owners, 123-Reg is concerned that this new system
could make it easier for your domain to be fraudulently transferred
away from 123-Reg. We would like to reassure you that we are taking
steps to guard against this happening to you. From the 12th, therefore,
all your non-UK domains registered with us will be automatically locked
so that only you can unlock them and initiate a transfer.
The new system will not affect your ability to manage your domain in
the usual way, and will simply mean that should you wish to change name
servers or transfer a domain away from 123-reg you will first need to
unlock it. This can be done quite simply from your 123-reg Control
Panel.
As we will be unable to accept liability if you unlock your domain and
an unauthorised transfer results, we strongly advise that you make sure
domains are kept locked at all times except when absolutely necessary
to change name servers or initiate a transfer.
Best Wishes,
The 123-Reg Team
Thankyou 123-reg for protecting me from the idiocy of ICANN which should now be named ICANN&IWILL.

A Concise History of Mathematics

I have just finsihed reading.
From: A Concise History of Mathematics
ISBN: 0486602559
Author: Dirk J. Struik
Edition: 4th
If one thing I can say without doubt this book is concise. It flys along at blistering pace and in just over 200 pages covers several thousand years of mathemtical history. If you are looking for a brief overvirew of the topic then this is the book.
It is also a great book to try and guage your interest in the topic. Its well written, well researched and enguaging so if you are unable rummage your way through it then I doubt one of the larger or more in depth coverages would suit you. This is of course coming from someone who has not yet read one of these but I am now looking at some of the older classics that I might try next.
One thing I have to mention is the citations. You could use this book to research topics in maths based on the amount of cited literature at the end of each chapter alone.
Personally I think the amount of work that has gone into this book is vast and in stark relation to its size. I would recommend it to any maths enthusiast or historian.

Diligent Editing of HTML

I am a fan of standards ie XHTML Transitional/Strict etc. To this end I do try to make sure that I am keeping my own sites reasonably compliant. Sites I do commercially are always 100% compliant but thats because I insist on it and they have placed their trust in me.
Just recently I have had to convert a really bad site to XHTML Transitional and if you had seen the markup you would have realized how big this task was. To go through it by hand would have been an enormous task and quite frankly I would have been unable to do it at the price I quoted without the following tools:
1. Vim ( Braam Moolenaar )
2. Template Toolkit TT2 ( Andy Wardley )
3. HTML Tidy (Dave Ragget)
4. W3C Validator ( The W3C Validator Team )
The first tool (Vim) could really be any good text editor ie Emacs, ed, or any of the vi children. I just happen to use Vim and once you have learned the basics joy to use and makes editing text almost an art.
TT2! the second tool is slightly more specialized and less well known but just as easy to use, but it deserves a big mention. TT2 is a templating system. Most people won’t really understand or even need to know what the advantages of this is until they need to edit a 10+ page website and hate it when someone wants to change a font on some item on all the pages. This could of course be done using server side includes or some other method but TT makes this easy but also exposes a programmatic API which make its functionality and versatility as wide as the programmers skills. This only scratches the surface of what TT can actually do for you.
The third tool is Dave Raggets HTML Tidy. This one tools is what saved me from going stark raving mad this weekend. Visually selecting an area in vim and then
‘<,’>!tidy -asxhtml -icbq -wrap 100
was what kept me sane. This single command will take ANY html fragment and sanitize it for you. It adds a lot of guff that you may not want but you can remove that and you have a sanitized version complete with CSS.
I just wanted the formatting, indenting and validation. I weeded out the CSS and I was left with a nice plain HTML document that I was then able to understand rather than some debauchery of a mess the devil would not have started with.
Using Tidy this way is a great way to get a clear place to start when converting a messy HTML page.
Last but not least is the W3C’s validator pages for both CSS and XHTML. After all the grunt work is over its time to check the pages and using the methods above I managed to come in with:
Out of 29 Pages:
20 html errors
2 css errors
this took me about 30 minutes to fix!

HTML Validation

I’m fairly lazy when it comes to validating my own site. I mean, who can be arsed making edits and then validating them all every time 😉
I know there are plenty of people who do it but I am not one of them. I normally check to make sure that it looks OK and thats about it. I am not even that concerned about displaying in Internet Explorer ( I have minimal real visitors a month and the rest is blog spam touting Viagra ). This is because I use Debian almost exclusively at work and at home and it is a major pain in the ass to check the windows side of things.
What I have tried to do is be quite strict with myself when I am making edits to my website. What this has resulted in is:
I checked 18 pages of my website and found 5 errors (all silly) all of which were on one page and caused by character references.
For those that have used the W3C validator this is not bad going at all. I know the purists will still think this is crap and that all HTML/XHTML should validate all the time. I believe this would be great too but unfortunately some of us have a life to lead outside the webosphere.
For those that always mean to get around to validating their websites but never do then my final word on HTML Validation is this:
“If you can’t validate religiously, at least edit diligently”
How can I say this. Well it takes more skill to get it right first time than to correct it after you have been shown your mistakes!!!

Welcome to the Collective! Resistance is futile!!!

I be you all though that Star Trek and the Borg was some pipe dream. Well not any more.
I am sure people are wondering why anyone would want to wear such a contraption but surely we would have said that about what is now the humble mobile phone earpiece just a few years ago. Its coming:
RESISTANCE IS FUTILE!!!
YOU WILL BE ASSIMILATED!!!

Catholic teenagers are sexually frustrated

and they are seeing sex in everything. Including Fruity sweetie wrappers
This made me howl. If someone had not pointed it out to me I would never have noticed it but it would appear that the Graduates from St Blasien Jesuit College, near Freiburg are seeing sex in everything. It sounds to me like they are the perverts if they are able to see two imaginary characters on a sweetie wrapper having sex!
Sometimes some people just go to far!

Dreamweaver is shit

Or at least my perception of it has been tainted by a website I am attempting to maintain that has been bolted together using dreamweaver. Note I did not use the word “constructed” or “built”. I prefer bolted because its a mess.
First:
Javascript is everywhere, most of which is bug ridden crap. Its being used to load images and has replaced the humble “link” on half the website. This has meant Google cannot see half the website which from a business point of view is critical. If the search engine cannot see your website then no one will find it!
Second:
Images everywhere. Every time a page was requested over 40 images were requested from the server. This is mad, on what appears to be a plain text website. with no adverts. 25% of the images happened to be used as 1 pixel spacers. This is absolute madness!
MAD MAD MAD BLODDY MAD

Political Bias swayed by Moon

The subject heading of this entry sounds a bit mad dosn’t it. I mean, who the hell would believe that the position of the moon could possibly affect the outcome of an election. It dosn’t, but there are those characters who are basing their election decision on the design of Mr Kerry and Mr Bush’s website. Now isn’t that fscked up. For those that don’t believe me take yourself over to slashdot and have a look around……
Does this mean we are seeing the entrance of the designer website. I can see it now
1. Websites by Gucci
2. Menu’s by Prada
3. Footers by Nike
Or, as a dialogue!
Manger
“Ohhh, love your hit counter”
Webmaster
“Yeah! we got Armani in to do it, worth every penny!”
Who the hell could possibly be that shallow?
Wait, we have Hello magazine, Cosmopolitan ( feminist trash ), FHM and Eurotrash that answers that question, the brain dead.

George W. Bush is an Idiot

As far as I am aware he now prevents foreign users from visiting and viewing his website. I am not making this up. Unless you are on a North American ip range you are forbidden from viewing his website.
This is the most powerful man on the planet who has more affect on foreign governments and their economies than some of the local governments do yet if you ain’t American ( an infidel ) you are not allowed to view his website.
The reason for this dumb ass decision is apparently due to his website getting cracked a few times. Do they really think that banning mass IP ranges is going to stop a real cracker, bollix. Its not hard to crack another PC from inside their borders then launch from there.
All this episode has done is made him and his administration look like people who don’t care about us foreigners. But then, why should he care now he hasn’t really given a damn before.
I hate getting involved in politics but some things are just too dumb to abstain from commenting on them.