Peter Brett's Blog

Paper for EUSAR 2012

2012-01-31T15:20:00.003Z

I'll be presenting a paper in an invited session on urban remote sensing at this year's European Conference on Synthetic Aperture Radar (EUSAR 2012). The preprint is now available on my website.

P.T.B. Brett and R. Guida. Geometry-Based SAR Curvilinear Feature Selection for Damage Detection. In 9th European Conference on Synthetic Aperture Radar - Invited Papers (EUSAR 2012 - Invited Papers), 23-26 April 2011. [Preprint]

In other news, I will be joining the boycott of Elsevier and their journals, and I encourage other researchers to do the same. Their behaviour is actively damaging to science.

Coming up to gEDA 1.7.2

2011-12-28T16:39:00.003Z

Later this week, gEDA/gaf 1.7.2 will be released! Hopefully, this will be the final unstable release before gEDA/gaf 1.8.0, and it will contain a few neat new things that we've been working on over the last six months.

As I've discussed previously, this release will incorporate all of the basic Scheme API functionality, to make it easier to write extensions for gschem in pure Scheme. I've had quite a few e-mails and feature requests from people who have been doing interesting things with the new API, and I'm looking forward to hearing about more tools for enhancing gschem! All of the new functions are documented in the gEDA Scheme Reference Manual.
In terms of documentation, I've completely re-written the gschem User Guide, more fully describing many features in gschem that were previously poorly documented, and hopefully making it easier to find the information you need. Gareth Edwards has done a fantastic job of adding man pages to gEDA, and now all of the programs we install have a properly-written man page.
The first parts of my rework of keymapping will also be included. Now key names will be properly internationalised when they're displayed, and having Caps Lock enabled will no longer mess up your keybindings. You can also now bind key combinations that use the Mod, Super or Hyper modifier keys.
You can now read gEDA documentation on Windows! (About time, really).

What's next once 1.7.2 has been released? Well, the most important thing is going to be to get a new stable release out. Many distributions are keen to move to Guile 2.0.x, and the current stable version of gEDA (1.6.2) doesn't support it. My current hope is to go into a string freeze for gEDA 1.8.0 very soon after gEDA 1.7.2 is released, and aim to get all the translations updated in time for a stable release at the end of January 2012.

There are many exciting plans for the 1.9.x branch of gEDA, but I'll leave them for another time...

Scheme API merge, and keybinding in gschem

2011-06-30T22:23:00.004+01:00

Earlier this week I merged the gEDA Scheme API that I've been working on since late 2009 into the main gEDA unstable branch. It's been a pretty great chunk of work, and I'm glad to have been able to get it into a state where it's generally useful. It's been pretty fun working out how to answer users' feature requests on gEDA-user with a short Scheme function, too! Hopefully people will take this new feature and do cool things with it.

One of the main obstacles to doing cool things with the new Scheme API is that it's difficult to modify key bindings on the fly — gschem doesn't have any equivalent to Emacs' global-set-key, for example. That makes it hard for e.g. an rc file or Scheme plugin loaded after system-gschemrc to add new keybindings or modify existing ones. There's also only a single keymap, so there's no possibility for user-modifiable state-specific keymaps (e.g. for binding keys that the user presses while placing a symbol).

While on the subject of keybindings, the way gschem currently displays keybindings in the menu bar is a little bit rubbish — for example, it would be good to display "]" instead of "bracketright", and "o S" instead of "oShift S". It's also a shame that we don't support a wider range of modifier keys, including "super" ("⊞" on most keyboards).

I'm planning to fix all these issues by adding a comprehensive set of Scheme functions for working with keys, key sequences and key bindings to gschem. Keymaps will probably become a hashtable-based record type, and there will be functions for creating a key sequence from a string and vice versa. There will also be a function for obtaining a "pretty" string describing a key, suitable for displaying in a menu or in the status line.

The gEDA Scheme API manual is here

2011-06-25T09:26:00.002+01:00

I'm currently working to get my guile-scheme-api branch ready to merge into the main unstable gEDA branch (master). One of the main jobs that needed to get done before that's possible was to write a reference manual for all of the Scheme functions and variables that the new Scheme API provides, and I've now done that!

If you're interested in writing extensions for gEDA, please take a look at the draft gEDA Scheme Reference Manual and let me know what you think. I'm keen to receive any feedback you might have, whether about the manual or about the API itself.

I'm hoping to merge my work so far in this branch into unstable within the next week. At the same time, I'm aiming to add the following missing functionality as soon as possible:

Object transformations (translation, rotation and mirroring)
Picture object creation and manipulation
Path object creation and manipulation (quite tricky, unfortunately)
File saving and loading
Picture and component embedding/unembedding

These are all things that I'm sure extension authors would be quite interested in having available to them! Hopefully we'll see all sorts of interesting new capabilities for gEDA users coming out soon.

gEDA and Guile — opportunities to get involved

2011-06-16T12:23:00.005+01:00

This is the eighth and last in a series of posts on extensibility in gEDA using Guile Scheme.

In this post, I'll summarise the series. In addition, I'll recap on the opportunities to get involved in gEDA development offered by the problems I've identified with the current gEDA codebase.

In my first and second posts, I described whereabouts in the gEDA codebase to find code which uses Guile, and also how to set up a build environment to easily compile gEDA against either Guile 1.8 or Guile 2.0. Being able to test with the latest stable release of Guile is quite important, and should definitely be considered by all gEDA developers!

In my third post, I dealt with probably the most important issue: dealing with non-local execution due to Scheme exceptions and continuations. There are a lot of places in gEDA where it's assumed that a call to a libguile or Scheme function will return normally, and that's not a safe assumption. Failing to protect against that (e.g. by using the "dynamic wind" mechanism) can easily result in resources being leaked.

The following post explained how to get notified when gEDA uses deprecated Guile APIs. It also gave an example of an instance where using deprecated API long after its deprecation has lead to actual bugs — the SCM_STRING_CHARS() and SCM_SYMBOL_CHARS() macros.

I went on to talk about the use of Scheme errors. I described the use of the SCM_ASSERT() macro to check function arguments, and also how to use Scheme errors more generally. The main points to remember here were that libguile has some really useful undocumented helper functions for raising Scheme errors from C code (see libguile/error.h), and that just because SCM_ASSERT() has "assert" in its name doesn't mean that you don't have to be careful about resource management if the test fails.

Finally, I talked about the guile-snarf tool that's used by my guile-scheme-api branch to generate boilerplate code for defining Scheme functions and variables from gEDA's C code.

There are several opportunities to get involved in making gEDA better. All these jobs are good for people who aren't that familiar with gEDA development, but who want to get to learn the codebase and about the development process, because they can mostly be done just on a function-by-function basis.

You can help change places where SCM_STRING_CHARS() is still used, to use scm_to_utf8_string() instead. I've already had some patches from Ivan Stankovic to deal with some of these!
You can look at the places where gEDA calls into libguile or calls Scheme functions to make sure that any potential errors are handled properly.
You can double-check that all gEDA functions that take SCM arguments validate them properly using SCM_ASSERT().
Or you can help make sure that gEDA Scheme functions raise Scheme errors properly when things go wrong.

If you're interested in submitting patches addressing any of these, or have any questions, please get in touch.

As previously mentioned, my focus for gEDA development in the near future is going to be on getting my guile-scheme-api branch merged, and I encourage everybody to try it out and let me know what you think! For information on my various branches and how to get hold of them, please see my gEDA development page.

gEDA and Guile — reducing boilerplate with "snarfing macros"

2011-06-15T09:33:00.007+01:00

This is the seventh in a series of blog posts on extensibility in gEDA using Guile Scheme.

Finding Scheme API code in gEDA
Compiling against multiple Guile versions
Safe handling of non-local exits
Dealing with deprecated libguile functions
Checking arguments to Scheme functions in C
How and when to use Scheme errors
Reducing boilerplate with "snarfing macros"
Opportunities to get involved

In this post, I will explain how you can use the guile-snarf tool to reduce the boilerplate needed to define Scheme functions and variables from C.

At the time of writing, this post isn't really relevant to the main gEDA unstable development branch, since it doesn't currently use "snarfing". It might be an interesting read if you're interested in hacking on my guile-scheme-api branch.

Why is "snarfing" needed?

One of the problems with using libguile to define Scheme functions from C is there's a certain amount of boilerplate setup code. For example, if I wish to define a function called "myfunc" in C to be usable from Scheme, I need to do something like:

static SCM
my_func (SCM arg)
{
  SCM_ASSERT (scm_is_string (arg), arg, SCM_ARG1, "my-func");

  /* ... do something useful ... */
}

/* Called during application initialisation */
void
my_init ()
{
  scm_c_define_gsubr ("my-func", 1, 0, 0, (SCM (*)()) my_func);
}

There are a few problems with this.

If the number of arguments to the function changes, an update needs to be made in two different places.
If the string name of the function changes ("myfunc" in this case), an update needs to be made in two places, and also to every other place the name is used (e.g. SCM_ASSERT() for arguments and any other place a Scheme error is raised).
If an extra function is added...

You get the idea.

Similarly, if there is a permanent Scheme value that's needed in multiple functions (such as a symbol) it's necessary to separately define the static variable and add a line to the initialisation function.

Finally, if the libguile API for defining a function or variable changes, it's necessary to individually update the initialisation code for every single one.

The `guile-snarf` tool

Guile comes with a tool called guile-snarf, which is run against a C source file to generate an additional C source file for inclusion, usually given a .x extension.

The tool recognises some special macros in the C source, which expand normally when compiled, but which are used by the tool to generate Scheme initialisation boilerplate. The example above would become:

SCM_DEFINE (my_func,   /* Function name in C */
            "my-func", /* Function name in Scheme */
            1, 0,      /* No. of required/optional args */
            0,         /* Whether accepts "rest" arg */
            (SCM arg), /* C argument list */
            "Do something exciting.") /* Docstring */
{
  SCM_ASSERT (scm_is_string (arg), arg, SCM_ARG1, s_my_func);

  /* ... do something useful ... */
}

/* Called during application initialisation */
void
my_init ()
{
  #include "mycfile.x";
}

This may seem like a small gain for this trivial example, but for files which define a large number of Scheme procedures there's a definite benefit! There are a few things to note:

Functions defined using SCM_DEFINE() are always static. This shouldn't normally be a problem, since they will usually be intended to be called from Scheme, not from other C functions.
For each function foo, SCM_DEFINE() also defines a static string called s_foo. This can be pretty handy, especially when needing to pass the Scheme name of the function to SCM_ASSERT() macros. (Its use is discouraged by the official documentation, but libguile itself makes use of it, so hey — it can't be that much of a problem!)

Although SCM_DEFINE is the main reason to use guile-snarf, there are several other really useful macros, such as SCM_SYMBOL("foo"), which creates & defines a variable containing the symbol "foo". In my guile-scheme-api branch, you will fairly commonly see a block at the top of a C source file looking like:

SCM_SYMBOL (lower_left_sym , "lower-left");
SCM_SYMBOL (middle_left_sym , "middle-left");
SCM_SYMBOL (upper_left_sym , "upper-left");
SCM_SYMBOL (lower_center_sym , "lower-center");
SCM_SYMBOL (middle_center_sym , "middle-center");
SCM_SYMBOL (upper_center_sym , "upper-center");
SCM_SYMBOL (lower_right_sym , "lower-right");
SCM_SYMBOL (middle_right_sym , "middle-right");
SCM_SYMBOL (upper_right_sym , "upper-right");

This then allows functions in the file to use the symbols to construct Scheme expressions to be evaluated without needing to recreate the symbols (e.g. using scm_from_utf8_symbol()) every time the function is run.

Conclusion

Currently, when wishing to alter the prototype a Scheme function provided by a gEDA program, you need to make changes in at least three places:

The function definition itself.
The function prototype in a header file.
The function metadata exported to Scheme, usually in a file called g_register.c.

Using the SCM_DEFINE() "snarfing" macro and the guile-snarf tool would allow two of those places to be eliminated, and that's why my guile-scheme-api branch uses them.

The next and final post in this series will summarise the things I've written about, and give a list of easy introductory gEDA development tasks based on some of the issues I've raised.

gEDA and Guile — how and when to use Scheme errors

2011-06-13T11:45:00.004+01:00

This is the sixth in a series of blog posts on extensibility in gEDA using Guile Scheme.

Finding Scheme API code in gEDA
Compiling against multiple Guile versions
Safe handling of non-local exits
Dealing with deprecated libguile functions
Checking arguments to Scheme functions in C
How and when to use Scheme errors
Reducing boilerplate with "snarfing macros"
Opportunities to get involved

In this post, I will try to make it clear how and when to raise Scheme errors in procedures implemented in C.

As explained in an earlier blog post in this series, Guile has a fully-fledged exception mechanism, which is used as the basis for its error reporting system. Because this allows execution to jump non-locally when an error occurs, it requires resources to be carefully managed.

Other than checking types using the SCM_ASSERT() macro, when else might it be useful to raise Scheme errors from C functions in gEDA?

When to raise Scheme errors

In Scheme functions written in Scheme, the answer is obvious: raise a Scheme error using error or scm-error. In C, it's not so simple.

Recall that there are currently four approaches to error handling in gEDA's C source code:

Give up (log an error message and quit immediately).
The GError mechanism from GLib.
Best-effort (log an warning message and return a default value).
Raise a Scheme error.

We try and avoid the "giving up" option, because quite often the situation is not actually hopeless, and the error could be handled by a function further up the stack or at the very least the user might be able to save his or her data.

In functions that are actual C API (i.e. designed primarily to be called by other C functions), Scheme errors are never appropriate, because they're quite complex to catch and handle in C. It's much easier to get from a GError to a Scheme error than the other way round! These sorts of functions should either use GError (for run-time errors outside the developers' control, such as being asked to load a file that doesn't exist), or use a "best-effort" approach (for programming errors, e.g. return NULL when asked for a list of objects in a NULL page).

On the other hand, functions that are designed primarily to be called from Scheme code should exclusively use Scheme errors. If there's a problem, either it'll be caught and handled, or it won't and an error message will be generated (and the program may exit).

This means that you shouldn't use best-effort helper macros like g_return_if_fail() — if you're called with invalid arguments, generate a Scheme error (e.g. using SCM_ASSERT()). You can apply a simple rule of thumb: if the SCM type appears in the function prototype, you should normally use Scheme error reporting.

How to raise Scheme errors

With libguile, the main function to use to raise Scheme errors is scm_error_scm(). However, the libguile headers provide some additional undocumented helper functions which make raising errors from C functions much more convenient. For example:

scm_error() is similar to scm_error_scm() but allows you to pass the raising function's name as a char * string rather than a Scheme string.
scm_misc_error() is the easiest way to generate errors for which it's not worth assigning a specific error key, and is the C equivalent to the error function in Scheme.

A full list of functions for raise errors is available in libguile/error.h, and since they are much better than scm_error_scm(), use them.

Don't forget that raising a Scheme error causes a non-local exit, and make provisions (such as using dynamic wind) to release any resources you hold correctly.

Conclusion

Guile provides a full-featured error-reporting system, which gEDA applications should use in their Scheme APIs more than they currently do. The best way to raise a Scheme error isn't via scm_error_scm(), but through the undocumented helper functions that libguile provides (and I should probably submit a documentation patch to upstream Guile to fix that...)

In my next post, I'll talk about the guile-snarf tool, and how to use Guile's "snarfing macros" to simplify the boilerplate needed to export C functions as callable from Scheme.

gEDA and Guile — checking arguments to Scheme functions in C

2011-06-12T09:51:00.006+01:00

This is the fifth in a series of blog posts on extensibility in gEDA using Guile Scheme.

Finding Scheme API code in gEDA
Compiling against multiple Guile versions
Safe handling of non-local exits
Dealing with deprecated libguile functions
Checking arguments to Scheme functions in C
How and when to use Scheme errors
Reducing boilerplate with "snarfing macros"
Opportunities to get involved

In this post I'll explain how to use the SCM_ASSERT() macro to check arguments passed to Guile functions written in C using libguile.

Using `SCM_ASSERT()`

SCM_ASSERT() is a shorthand way to raise a Scheme wrong-type-arg error for a Scheme variable if a test fails. For example, if there is a function which takes a string as an argument, you might write it as:

SCM
myfunc (SCM str)
{
  SCM_ASSERT (scm_is_string (str), str, SCM_ARG1, "my-func");

  /* ... do things with str ... */
}

All functions in gEDA which are exposed as Scheme procedures must use SCM_ASSERT() to thoroughly check the types of their arguments.

There are a few things to note:

The first parameter to SCM_ASSERT() is a test, and should evaluate to an integer, not a Scheme value. If the test is zero, an error is signalled.
If you need to use a test which evaluates to a Scheme value (e.g. scm_list_p()), don't compare it to SCM_BOOL_F or SCM_BOOL_T directly; use scm_is_true() or scm_is_false().
The second parameter is the variable which has the wrong type. Although the test might not be on it directly (e.g. if you are checking for a list of strings), the second parameter must always be the actual argument which was passed to myfunc.
The third parameter to SCM_ASSERT() indicates which argument to myfunc had the wrong type — and remember that this is 1-indexed. Although this parameter is just an integer, you should always use the SCM_ARG1, SCM_ARG2 etc. macros for arguments up to 7, since this makes the purpose of the parameter more readable.
If you have a function that takes an arbitrary number of parameters, you should use the SCM_ARGn macro as the argument index.
The final parameter is a char * string containing the name of the function as seen by Scheme ("my-func" in this case).

If you have a C helper function which is used by many similar Scheme functions, you can generate more useful error messages if you pass it the name of the function that's actually visible to Scheme code. For example:

void
helperfunc (SCM str, const char *funcname)
{
  SCM_ASSERT (scm_is_string (str), str, SCM_ARGn, funcname);

  /* ... do things ... */
}

void
myfunc (SCM str)
{
  helperfunc (str, "my-func");

  /* ... do more things ... */
}

Don't leak resources!

The most important thing to remember is that SCM_ASSERT() does not behave like most normal assertion mechanisms when programming in C (g_assert() in GLib for example), in that it doesn't end the program if it fails — it simply causes a non-local exit by raising an error.

Because SCM_ASSERT() might not return, it's really important to be careful about managing resources when writing a Scheme function in C. For example, consider a function that needs to convert a Scheme list of strings into a GList of C strings. Here's a naive, broken implementation:

/* Don't do this -- it leaks memory */
void
process_string_list (SCM lst)
{
  GList *glst = NULL;
  SCM_ASSERT (scm_is_true (scm_list_p (lst))), lst, SCM_ARG1,
              "process-string-list");

  for (SCM iter = lst; iter != SCM_EOL; iter = SCM_CDR (iter)) {
    SCM str = SCM_CAR (iter);
    SCM_ASSERT (scm_is_string (str)), lst, SCM_ARG1, "process-string-list");
    glst = g_list_prepend (glst, scm_to_utf8_string (str));
  }

  /* ... do something with glst ... */
}

If the SCM_ASSERT() inside the loop raises an error, the stack will unwind out of process_string_list() and the memory allocated in glst will be leaked. Instead, you could check the input, and then build the list:

void
process_string_list (SCM lst)
{
  GList *glst = NULL;
  SCM_ASSERT (scm_is_true (scm_list_p (lst))), lst, SCM_ARG1,
              "process-string-list");

  /* Check the input is actually a list of strings */
  for (SCM iter = lst; iter != SCM_EOL; iter = SCM_CDR (iter)) {
    SCM_ASSERT (scm_is_string (SCM_CAR (iter)), lst, SCM_ARG1, "process-string-list");
  }

  /* Convert to a GList */
  for (SCM iter = lst; iter != SCM_EOL; iter = SCM_CDR (lst)) {
    glst = g_list_prepend (glst, scm_to_utf8_string (SCM_CAR (iter)));
  }

  /* ... do something with glst ... */
}

The problem with this is that it is inefficient, as it requires iterating over the linked list twice. A more efficient approach would be to use dynamic wind, as I discussed in a previous post in this series.

/* A function for freeing a GList containing strings */
static void
free_string_glist (void *data)
{
  GList *glst = *((GList *) data);
  for (GList *iter = glst; iter != NULL; iter = g_list_next (iter)) {
    free (iter->data);
  }
  g_list_free (glst);
}

void
process_string_list (SCM lst)
{
  GList *glst = NULL;
  SCM_ASSERT (scm_is_true (scm_list_p (lst))), lst, SCM_ARG1,
              "process-string-list");

  /* Begin a dynamic extent, and register a handler to clean up on error */
  scm_dynwind_begin (0);
  scm_dynwind_unwind_handler (free_string_glist, (void *) &glst, 0);

  /* Convert to a GList, checking types */
  for (SCM iter = lst; iter != SCM_EOL; iter = SCM_CDR (iter)) {
    SCM str = SCM_CAR (iter);
    SCM_ASSERT (scm_is_string (str)), lst, SCM_ARG1, "process-string-list");
    glst = g_list_prepend (glst, scm_to_utf8_string (str));
  }

  /* End dynamic extent */
  scm_dynwind_end ();

  /* ... do something with glst ... */
}

Update: Thanks to Ivan Stankovic for pointing out a bug in this example!

Unfortunately, there appear to be quite a few places in gEDA where there is the potential for resource leakage like this to occur, and checking that all functions which use SCM_ASSERT() do so in a safe manner would be a really useful thing to do.

Conclusion

As you can tell, even doing something as conceptually simple as checking your arguments safely can be a tricky thing to get right when using libguile — another argument, if you needed one, for keeping the number of functions in gEDA's Scheme API as small as possible while still exposing all of the necessary functionality.

In my next post, I'll discuss how (and when!) in general to throw Scheme errors from C.

gEDA and Guile — dealing with deprecated libguile functions

2011-06-11T09:04:00.009+01:00

This is the fourth in a series of blog posts on extensibility in gEDA using Guile Scheme.

Finding Scheme API code in gEDA
Compiling against multiple Guile versions
Safe handling of non-local exits
Dealing with deprecated libguile functions
Checking arguments to Scheme functions in C
How and when to use Scheme errors
Reducing boilerplate with "snarfing macros"
Opportunities to get involved

In this post I'll explain how to set up your environment to get warnings about use of deprecated libguile API, and some of the most problematic deprecated API usage in gEDA.

Getting notified about deprecated API usage

Most gEDA applications use something like the following to disable deprecation warnings unless you specifically set your environment to request them:

if (getenv ("GUILE_WARN_DEPRECATED") == NULL)
  putenv ("GUILE_WARN_DEPRECATED=no");

The simplest way to enable deprecation warnings is, therefore, to add something like this to your shell rc file:

GUILE_WARN_DEPRECATED="detailed"
export GUILE_WARN_DEPRECATED

Now when you start gschem, you'll get a few warnings on stderr (depending on which version of Guile you've compiled against). Here's an example of what you see when starting gschem if you compile against Guile 2.0:

$ gschem

`(debug-enable 'debug)' is obsolete and has no effect. (1)

Remove it from your code.

SCM_STRING_CHARS is deprecated.  See the manual for alternatives. (2)

SCM_SYMBOL_CHARS is deprecated.  Use scm_symbol_to_string. (3)

Some of this is a problem, some of it isn't.

We use (debug-enable 'debug) in system-gafrc to enable backtraces in Guile 1.8, but it does nothing in Guile 2.0. It would be nice to find a way to only call it if necessary, but it's not really a priority.
SCM_STRING_CHARS() is used a lot in gEDA to obtain a pointer to the underlying character buffer of a Scheme string, and it's been deprecated since Guile 1.8.0. gEDA's reliance on this is a bit of a problem, unfortunately, and I'll explain why later.
SCM_SYMBOL_CHARS() is similar to SCM_STRING_CHARS() (but for the string representation of a Scheme symbol), and has also been deprecated for a long time.

The problem with `SCM_STRING_CHARS()` and `SCM_SYMBOL_CHARS()`

So, why is using SCM_STRING_CHARS() a problem? The main issue is that its use assumes that Guile's internal string representation is the same as gEDA's, i.e. an array of char, and that Guile's internal string encoding is the same as gEDA's, i.e. UTF-8. Neither of these assumptions are reliable.

There are two different internal representations for strings in Guile 2.0. All strings are stored as an array of Unicode code points.

If all the code points are in the range 0-255 inclusive, the code points are stored with one byte per code point, i.e. as Latin-1 or ISO-9959-1. This is not UTF-8.
If any of the code points is outside that range, the whole string is stored with four bytes per code point, i.e. as UTF-32. This is also not UTF-8.

Additionally, Guile 2.0 introduces read-only strings (which don't work with SCM_STRING_CHARS()) and shared substrings (which don't work with SCM_STRING_CHARS()).

So how can we break a function func that takes a single string argument and uses SCM_STRING_CHARS()? Let me count the ways.

We can pass it a string containing code points above 255. Since we target a worldwide user base these days, that's not particularly unlikely.
(func "你好")
We can pass it a shared substring.
(func (substring/shared "foo bar" 0 3))

We can pass it a read-only substring

(func (substring/read-only "foo bar" 0 3))

SCM_SYMBOL_CHARS() shares all these problems. Both these macros have been deprecated since Guile 1.8.0 exactly because the Guile developers wanted to be able to change Guile's original internal string representation to support Unicode fully. (In case you're wondering why they don't use UTF-8, it's because Scheme requires a bunch of string operators that operate on the nth character in a string, and using UTF-8 would make those operators much slower).

Replacing `SCM_STRING_CHARS()`

What's the alternative? Ideally, we'd use the rather handy scm_to_utf8_stringn() function, but that was only introduced in Guile 2.0 (along with Unicode support), so it's not an option. Instead, we have to rely on scm_to_locale_string(). The main difference between the new functions and SCM_STRING_CHARS() is that the new functions allocate memory, which must be freed with free() (n.b. not g_free()).

Update: gEDA now provides scm_to_utf8_string() and scm_from_utf8_string() even if Guile doesn't, so always use them unless you actually want to work with locale-encoded strings.

So suppose we started off with a version of myfunc() that uses SCM_STRING_CHARS():

void
myfunc (SCM arg)
{
  /* N.b. we should check that arg is in fact a string */
  printf ("%s", SCM_STRING_CHARS (arg));
}

It should be replaced by:

void
myfunc (SCM arg)
{
  char *arg_str;
  /* N.b. we should check that arg is in fact a string */
  arg_str = scm_to_utf8_string (arg);
  printf ("%s", arg_str);
  free (arg_str);
}

In reality, you'll want to do something more complicated than just print the string. Don't forget that if you do more than trivial calls into libguile in between creating arg_str and freeing it you should probably use dynamic wind to make sure that it is properly cleaned up.

You should also be aware that because scm_to_utf8_string() tries to return a null-terminated string, it throws an error if the string contains #\nul characters. It can throw an error if the string can't be converted to the requested encoding (which is locale-dependent for scm_to_locale_string()). This introduces its own challenges.

Replacing `SCM_SYMBOL_CHARS()`

Replacing SCM_SYMBOL_CHARS() is similar to replacing SCM_STRING_CHARS(); simply use scm_symbol_to_string() to convert the symbol to a string, and then use scm_to_utf8_string() as before.

Conclusion

Library APIs are rarely deprecated without a good reason, and being aware of and proactive about updating deprecated API usage can help avoid some serious problems. Updating gEDA to remove the use of the SCM_STRING_CHARS() and SCM_SYMBOL_CHARS() macros is an important job. Nevertheless, it would still be quite accessible for someone less familiar with the gEDA code base, as it can be done by dealing with one function at a time.

In my next post, I will describe how to use SCM_ASSERT to check types of SCM arguments to functions that use libguile.

gEDA and Guile — safe handling of non-local exits

2011-06-10T11:07:00.009+01:00

This is the third in a series of blog posts on extensibility in gEDA using Guile Scheme.

Finding Scheme API code in gEDA
Compiling against multiple Guile versions
Safe handling of non-local exits
Dealing with deprecated libguile functions
Checking arguments to Scheme functions in C
How and when to use Scheme errors
Reducing boilerplate with "snarfing macros"
Opportunities to get involved

In this post I'll be talking about an issue which the current gEDA codebase doesn't deal with very well: dealing with non-local exits in C code that uses libguile.

What are non-local exits?

Non-local exits are a way for execution to jump out of the current execution context to another point in the program. The only way of doing this in C is through the quite limited setjmp/longjmp mechanism .Guile supports two fully-featured constructs for non-local control flow: exceptions and continuations.

Exceptions will be fairly familiar to many developers, as they are heavily used in languages such as Java and Python. When an exception is thrown, the stack is unwound until an exception handler is found for the exception. If none is found, then the program will usually exit with an uncaught exception error. Guile uses exceptions to implement its error handling mechanism, and you can read about that in more detail in the Guile manual (Exceptions, Error Reporting).

The other way that a non-local exit might occur is via a continuation. These are pretty hard to get your head around, unfortunately. The Guile manual describes them as follows:

A “continuation” is the code that will execute when a given function or expression returns. For example, consider
(define (foo) (display "hello\n") (display (bar)) (newline) (exit))
The continuation from the call to bar comprises a display of the value returned, a newline and an exit. This can be expressed as a function of one argument.
(lambda (r) (display r) (newline) (exit))
In Scheme, continuations are represented as special procedures just like this. The special property is that when a continuation is called it abandons the current program location and jumps directly to that represented by the continuation.

A continuation is like a dynamic label, capturing at run-time a point in program execution, including all the nested calls that have lead to it (or rather the code that will execute when those calls return).

Guile implements continuations that are usable from C code with some pretty crazy techniques for saving and restoring the C stack.

The important point to take away from this is that when you call a Scheme function from C, you cannot depend on it returning normally. That means that totally legitimate resource management in a normal C/GLib program, such as:

void myfunc()
{
  gchar *buf = g_strdup ("const string");
  anotherfunc (buf);
  g_free (buf);
}

becomes unsafe if anotherfunc() calls Scheme code that might either call a continuation or throw an exception, since in that case the call to g_free() would never occur and the memory assigned to buf will be leaked.

In gEDA there are several places which do exactly this, and they need fixing.

Dealing with non-local exits safely

Fortunately, Guile provides two mechanisms for dealing with this, called Continuation Barriers and Dynamic Wind.

Continuation barriers are the less powerful of the two mechanisms, but are simpler to understand. They simply block both exceptions and continuations from entering or leaving the context of the barrier call. Here is how to modify the previous example to use a continuation barrier:

void myfunc()
{
  gchar *buf = g_strdup ("const string");
  scm_c_with_continuation_barrier (anotherfunc, buf);
  g_free (buf);
}

There's an obvious disadvantage to this approach: you can't catch and handle exceptions which occur, or allow exceptions to propagate upward to the function that called myfunc() in case they can be caught and handled there!

Dynamic wind provides a more flexible method. The scm_dynwind_start() and scm_dynwind_end() functions delimit a dynamic extent, and it's possible to register actions to be carried out whenever the dynamic extent is entered or left (e.g. due to a continuation or exception). It's also possible to indicate that non-local exits from the dynamic extent are permitted, but non-local entries aren't (this is the usual thing to do when using dynamic wind from C code).

Here is myfunc() modified to use dynamic wind:

void myfunc()
{
  /* Begin a dynamic extent that can't be re-entered */
  scm_dynwind_begin (0);

  gchar *buf = g_strdup ("const string");

  /* Make sure that buf is freed when the dynamic extent is
   * left either locally or non-locally */
  scm_dynwind_unwind_handler (g_free, buf, SCM_F_WIND_EXPLICITLY);

  anotherfunc (buf);

  /* End dynamic extent */
  scm_dynwind_end ();
}

This ensures that buf is always freed. If anotherfunc() raises an exception, or it calls a continuation that jumps out of myfunc(), the unwind handler will make sure that the string is freed. Since the SCM_F_WIND_EXPLICITLY flag was passed to scm_dynwind_unwind_handler(), the handler will also be called if the call to scm_dynwind_end() is reached and the function returns normally.

Conclusion

One task that's well past due is a review of functions in gEDA that call into Scheme to make sure that they safely handle non-local exits, either by using continuation barriers, dynamic wind, or the "protected" functions provided in libgeda (see libgeda/src/g_basic.c). This would be ideal for someone less familiar with the code base to tackle, since it can be approached on a function-by-function basis.

In my next post, I will describe how to set up your environment to get notifications about use of deprecated libguile API usage in gEDA, and in particular the problems caused by the continued use of the long-deprecated SCM_STRING_CHARS macro.

gEDA and Guile — compiling against multiple Guile versions

2011-06-09T10:02:00.011+01:00

This is the second in a series of blog posts on extensibility in gEDA using Guile Scheme.

Finding Scheme API code in gEDA
Compiling against multiple Guile versions
Safe handling of non-local exits
Dealing with deprecated libguile functions
Checking arguments to Scheme functions in C
How and when to use Scheme errors
Reducing boilerplate with "snarfing macros"
Opportunities to get involved

In this post, I'll explain how to set up your build environment in such a way that you can easily compile gEDA against either Guile 1.8 or Guile 2.0, since we need to support using gEDA with either version of Guile at the moment.

Firstly, you need to build and install Guile 2.0 and Guile 1.8 to their own prefixes, e.g. /opt/guile-2.0/ and /opt/guile-1.8/.


$ wget ftp://ftp.gnu.org/gnu/guile/guile-2.0.1.tar.gz

$ tar -zxf guile-2.0.1.tar.gz

$ cd guile-2.0.1

$ ./configure --prefix=/opt/guile-2.0

$ make

$ sudo make install



$ wget ftp://ftp.gnu.org/gnu/guile/guile-1.8.8.tar.gz

$ tar -zxf guile-1.8.8.tar.gz

$ cd guile-1.8.8

$ ./configure --prefix=/opt/guile-1.8

$ make

$ sudo make install

Next, you need to have some way of quickly adding and removing the different versions of Guile to your environment. Specifically, you need to be able to modify INFOPATH, PATH, MANPATH, LD_LIBRARY_PATH and PKG_CONFIG_PATH.

The approach I use is to use Environment Modules (henceforth referred to as modules). The idea is to be able to do something like this:


$ module load guile/1.8

$ which guile

/opt/guile-1.8/bin/guile

$ module switch guile guile/2.0

$ which guile

/opt/guile-2.0/bin/guile

One particularly neat thing about modules is that although I give all my examples here for POSIX sh and/or bash, the same module files can be used with other shells such as tcsh with no modification.

Installing & setting up Environment Modules

Unfortunately, modules can be a bit of a pain to install, and many distributions don't appear to package it. This is a guide to getting it working on Ubuntu 10.04; it's much easier on Fedora, since there you can just install the environment-modules package.

Due to a really obnoxious default file layout that's not at all trivial to fix, it's easiest to install modules to its own prefix, e.g. /opt/Modules. You'll need to do something like this (after downloading the source code):


$ tar -zxf modules-3.2.8a.tar.gz

$ ./configure --disable-versioning --prefix=/opt

$ make

$ sudo make install

It's then necessary to set up your ~/.bash_profile and ~/.bashrc to enable modules for your sessions. Firstly, you need to add some boilerplate to the top of ~/.bash_profile:


if [ -f /opt/Modules/init/bash ]

then

  # Set the file to store your initial environment in

  export MODULESBEGINENV=$HOME/.modules/beginenv

  # Initialise environment for modules

  . /opt/Modules/init/bash

  # Set a directory for your personal module files (create this directory)

  module use $HOME/.modules

  # Load some default modules

  module load guile

fi

It's also useful add this to your ~/.bashrc, to make sure that when you start a new shell your environment is preserved:


if [ ! -z "$MODULESHOME" ]; then

  module() { eval `$MODULESHOME/bin/modulecmd bash $*`; }



  module update # Need to reload modules because of setuid utmp

fi

Creating modules for Guile versions

The next step is to make the module files for the two versions of Guile. These will be called /opt/Modules/modulefiles/guile/1.8 and /opt/Modules/modulefiles/guile/2.0, and will look like this:


#%Module1.0

prepend-path PATH /scratch/opt/guile-2.0/bin

prepend-path LD_LIBRARY_PATH /scratch/opt/guile-2.0/lib

prepend-path PKG_CONFIG_PATH /scratch/opt/guile-2.0/lib/pkgconfig

prepend-path INFOPATH /scratch/opt/guile-2.0/share/info

prepend-path MANPATH /scratch/opt/guile-2.0/share/man

with 2.0 replaced by 1.8 for /opt/Modules/modulefiles/guile/1.8.

Finally, it's necessary to tell modules which version of Guile should be the default, for when a user asks for module load guile. We can do this by adding a /opt/Modules/modulefiles/guile/.modulerc file.


#%Module1.0

set ModulesVersion 2.0

Putting it all together

After re-initialising your session (probably easiest to log out and back in again), you should be able to swap between versions of Guile using module load and module switch as described above.

You should now be easily able to compile gEDA against either version of Guile without too much difficulty — simply load the appropriate environment module, and then run:


$ ./config.status --recheck && ./config.status && make

In my next post I will discuss one of the problems that's quite common in gEDA's use of Guile: unsafe behaviour on non-local exits such as Scheme exceptions.

gEDA and Guile — finding Scheme API code in gEDA

2011-06-08T15:11:00.006+01:00

The response to my previous post was overwhelmingly in favour of continuing and merging my work on gEDA extensibility using Guile Scheme, both here and on the gEDA mailing lists. Some people asked how they could help out, and so I'm going to write a series of blog posts with some information on how gEDA uses Scheme and some easy introductory tasks that would be useful.

Finding Scheme API code in gEDA
Compiling against multiple Guile versions
Safe handling of non-local exits
Dealing with deprecated libguile functions
Checking arguments to Scheme functions in C
How and when to use Scheme errors
Reducing boilerplate with "snarfing macros"
Opportunities to get involved

In this blog post, I'll explain where Guile is used in gEDA at the moment, both C code using libguile and Scheme code itself.

What is Scheme used for?

Currently, Guile is used for:

Executing "configuration" files (actually initialisation files) written in Scheme, in all libgeda applications.
Setting up the menus and keybindings in gschem. Key sequences and menu items call Scheme "thunks" (functions of no arguments), which are mostly implemented in C. It's not currently feasible to create a meaningful new action in gschem without writing it mostly in C.
Exporting netlists in gnetlist. A gnetlist backend generates particular on-disk netlist file format using a limited API that provides access to the compiled netlist.
A few other things (mostly incomplete). For example, there is a very limited existing Scheme API spread between gschem and libgeda for taking actions on changes to pages and/or attributes.

It would be nice to do more things (like extending gschem with additional actions written in pure Scheme, or being able to modify the way that gnetlist compiles a netlist from input schematics).

Where is the Guile code in gEDA?

In the C sources, files which contain code using libguile usually begin with the prefix "g_". For example, "g_rc.c" contains definitions of functions used for configuration parameters, and "g_register.c" contains code for registering C functions and variables to be visible from Scheme. There are a bunch of exceptions to be aware of, which include:

libgeda/src/s_clib.c contains some libguile code that permits component libraries to be defined as a set of Scheme functions.
libgeda/src/s_menu.c contains some basic infrastructure for menu definitions in Scheme rc files that's past due to move into gschem.
libgeda/src/s_menu.c has functions for converting gEDA colour map data to and from Scheme representations.
Several gschem source files contain snippets of libguile code for firing hooks when the user carries out certain actions.
gschem/src/x_menus.c implements menus defined in Scheme, and gschem/src/x_stroke.c provides support for assigning gestures to actions in Scheme (which capability I'm not sure I've ever used).

More generally, you can usually find code that uses libguile by searching for the "scm_" or "SCM_" prefix used by libguile functions, macros and variables.

Most of the application directories in the gEDA source tree have a "scheme" subdirectory where most of the ".scm" files with Scheme code live. There are also the system rc files for each application, which are also written in Scheme but for some reason live in "lib" subdirectories.

So that's a brief overview of where the Scheme-related code lives in gEDA. In my next post, I will talk about how to set up your build environment to be able to easily build against either Guile 1.8 or Guile 2.0.

Porting gEDA to Guile 2.0, and future plans

2011-06-05T11:41:00.004+01:00

Guile, a Scheme implementation that's part of the GNU project, recently put out a new 2.0 release with many exciting new features and improvements.

gEDA relies on Guile for extensibility. In the past we have had a few problems moving to new versions of Guile, often due to differences between memory management APIs or library functions.

I first started looking at Guile 2.0 support in gEDA in December 2010. At the time, I had great difficulty getting libgeda to work due to differences in the debugging APIs between Guile 1.8 and 2.0. However, during January I did a considerable amount of work on how Scheme errors are reported in libgeda, and as part of that I managed to do things in a way compatible with both versions of Guile.

Last Friday I was therefore able to get gEDA fully working with Guile 2.0. Actually, the main remaining obstacle was that the new version of Guile is much stricter about correct Scheme syntax, and some of the gnetlist backends needed fixing up.

But that's done, and gEDA is now fully compatible with Guile 2.0 and can take advantage of the performance improvements it brings!

What's next for me in terms of gEDA development? Well, I still have several different development branches on the go, and I'm not sure which of them (if any) to focus on.

I have a branch which extensively refactors, extends and improves the libgeda scheme API, with the intention of making it possible to write much more fully-featured plugins & extensions for gschem and gnetlist.
I have done a lot of work on splitting the cairo rendering code out of gschem into a separate library called libgedacairo, in order to make it easier to write applications that display gEDA schematics or convert them to other graphics formats. (As part of of this work, I'm also modifying gschem to take advantage of the GTK+ printing APIs).
I have a design for a new configuration system for gEDA, which is non-executable and can provide per-schematic-page configuration. This is intended to remove a security flaw in gEDA at the moment when opening designs received from others.

Or are there other, more urgent things that need work? let me know what you think.

Papers presented at JURSE 2011

2011-04-12T08:26:00.005+01:00

I'm presenting two papers at this year's Joint Urban Remote Sensing Event being held in Munich this week. The proceedings are not yet available on IEEE Xplore, but I have made preprints available on my website.

P.T.B. Brett and R. Guida. Bright line detection in COSMO-SkyMed SAR images of urban areas. In Joint Urban Remote Sensing Event 2011 (JURSE 2011), pages 253-256, 11-13 April 2011. [Preprint]
R. Guida and P.T.B. Brett. A SAR image-based tool for prompt and effective earthquake response. In Joint Urban Remote Sensing Event 2011 (JURSE 2011), pages 213-216, 11-13 April 2011. [Preprint]

Weekly News Stash

2011-03-26T11:22:00.001Z

There have been a large number of blog posts and news stories over the last week that I found interesting, but I didn't have time to blog on each of them individually. Instead, here are the highlights. I've probably missed a bunch of relevant stuff, so please feel free to point them out in the comments.

Libya and Wikileaks

Tom Watson (MP for Bromwich West) posted on his blog to assert that the UN and allied intervention in the Libyan insurgency (or uprising or civil war, depending on your perspective) constitutes "the first Wikileaks war".

Understandably, this development blows the minds of liberals who have stoically supported WikiLeaks as an innovative new international information movement that would almost certainly deflate the interventionist and imperialist tendencies of the big western powers… the smartest pro-transparency analysts have always realized that the revelations the U.S. cables represented would almost certainly lead to unforeseen consequences, if not armed conflict.

I'm not sure I entirely agree that one can entirely lay the blame for the situation at the door of Wikileaks. I believe that the rise of social networking (especially Twitter and Facebook) as well as citizen journalism via blogging and video sharing sites such as YouTube have played as much as an enabling role — or perhaps even more so.

In related news, Bradley Manning, the US serviceman accused of being responsible for the leaking of large amouts of classified US embassy cables (among other materials) has now been incarcerated in solitary confinement and and subjected to routine psychological torture for over 300 days. Whether or not you consider him a criminal and deserving of punishment, I believe that "no-touch torture" is still torture, torture is barbaric and should never occur in a country that considers itself civilised, and that Bradley's rights both to a speedy trial and to be considered innocent until proven guilty have both been brutally violated. Loz Kaye, leader of the Pirate Party UK, gave a very well received speech on the subject at last Sunday's protest outside the US Embassy in Grosvenor Square.

Engagement with the Liberal Democrats

Loz also was recently invited to take part in a panel session on "Who controls the Internet?" at the Liberal Democrat party conference, and subsequently contributed a blog post on the Pirate Party perspective to the Lib Dem Voice blog.

Both his article and the comments are worth a read. In particular, they demonstrate that even within the Lib Dems, opinion is heavily divided on the issues of Internet governance and intellectual property policy and enforcementt. A microcosm of this, of course, can be seen in Parliament; contrast the behaviour Lord Clement-Jones in the Lords and Julian Huppert, MP for Cambridge, in the Commons.

In academia

There have been several interesting news stories from academic research in the last week.

Firstly, a paper from Joel Waldfogel, an economist at the University of Minnesota. He carried out some research into claims by the recording industry that copyright infringement was stopping new music or new artists coming to market, and published a paper on his results, whimsically entitled "Bye, Bye, Miss American Pie?" Not only was he unable to find any evidence that the rise of Napster and peer-to-peer filesharing have resulted in an impact on either, but he also found that there has been a significant shift from the major labels to independent labels in the releasing of new music. (More coverage from Michael Geist, TorrentFreak and Techdirt).

The 1709 blog reported on a talk given by Professor Paul Heald entitled "Do bad things happen when works fall into the public domain?". In particular he debunked both the assertion that falling into the public domain will lead to underusage of works, and that it will result in the devaluation of works. I note that he's published on the subject, and I'm going to try to get hold of his papers, as they sound like they will be interesting reading.

From the London School of Economics there came a highly critical report on the deservedly-maligned Digital Economy Act 2010, called "Creative Destruction and Copyright Protection." In particular, it has this to say:

The DEA gets the balance between copyright enforcement and innovation wrong. The use of peer-to-peer technology should be encouraged to promote innovative applications. Focusing on efforts to suppress the use of technological advances and to protect out-of-date business models will stifle innovation in this industry.

Another article critical of the DEA has been published by William Dutton at the University of Oxford. Called "Aiming at Copyright Infringers and Hitting the Digital Economy", it argues strongly that the Act will not only not achieve its stated objectives, but will in fact have several negative effects. The article actually mentions the Pirate movement, and quotes from the PPUK manifesto!

It's nice to see academia providing some objective criticism of the oft-repeated claims of the copyright industries — claims which so far no independent research has been able to substantiate or reproduce, despite how often they crop up.

In the courts

The High Court hearings for the judicial review of the aforementioned Digital Economy Act are currently taking place. They started last Wednesday, and are expected to conclude sometime next week. Will Tovey has posted some commentary on the Pirate Party UK blog. Summary: no matter what the outcome, the result is almost certain to be appealed, and it's quite likely to go all the way to the European Court of Justice, meaning that we could be looking at a couple of years before the final outcome is decided.

The big headline his week is that a selection of record labels are suing the company behind the Limewire filesharing software for a total of 75 trillion US dollars (to be precise, $ 7.5x10¹³) in statutory damages. To put that into perspective, the GDP of the entire world is only $75.5 trillion, and the global money supply is only approx. $50 trillion. It would therefore be accurate to say that Limewire is being sued for all the money in the world. I consider this excellent evidence for the fact that the statutes are wrong. This Slashdot comment was the best take on the ridiculous situation that I've read so far.

Now how in the hell does that promote "progress of the arts and sciences"? Answer: it doesn't, it is simply a way for a "leecher class" to make eternal checks off locking up the entire culture of a race. How many works have already been lost simply because nobody could legally make a copy and the copyright holders couldn't figure out a way to "monetize the IP" and just let it rot?

That's it for this week. Hopefully next week there won't be quite so many items that I'm desperate to share with the world!

Survey on "Open Standards in the Public Sector"

2011-03-23T14:15:00.003Z

The Cabinet Office is currently carrying out a survey on "Open Standards in the Public Sector". The widespread use of open standards in government would be a major step forward for the UK, both in terms of stimulating innovation in the IT sector by lowering barriers for entry in the public sector, and in terms of ensuring that everybody is able to use and interact with UK government online services without being required to use a particular software platform or limited set of platforms.

Two areas of the survey were of particular interest to me: the opening section on defining what exactly an "open standard" is, and the section on standards that are being evaluated for computer workstations. The survey, however, covers a huge array of areas for possible standardisation in IT (for example, content syndication, e-voting, web services and VoIP), and there's lots of scope for people with domain-specific knowledge to contribute on the areas that they're most familiar with.

I encourage everyone who is interested in seeing increased adoption of open standards in governmental IT procurement to take part in this survey — and in particular, to encourage the UK to standardise on PDF and OpenDocument rather than Microsoft's bought-and-paid-for non-standard, Office "Open" XML.

What is an open standard?

The survey outlines five conditions for an open standard that the government proposes:

1. Open standards are standards which result from and are maintained through an open, independent process.

Open standards need not necessarily result from an open and independent process -- as a classic example, the Internet Protocol and Transmission Control Protocol (TCP/IP) on which the Internet is based were developed behind closed doors by a small working group at Stanford in the early 1970s. However, I would agree that the success of TCP/IP as an open standard has very much depended on the fact that it has been maintained by an open and independent organisation (the IETF).

2. Open standards are standards which are approved by a recognised specification or standardisation organisation, for example W3C or ISO or equivalent.

There are two sources of concern with this condition. Firstly, it is unclear who maintains the list of "recognised" specification or standardisation organisations, nor how such an organisation can become "standardised", and greater clarity would be appreciated. Secondly, the ISO in particular operates extremely slowly, and waiting for ISO standardisation of an already-widely-used open standard may well hamper flexibility and responsiveness in government procurement. However, in principle this condition seems a sensible one.

3. Open standards are standards which are thoroughly documented and publicly available at zero or low cost.

This is an essential condition. If a standard's documentation cannot be be easily and inexpensively obtained, it provides a serious barrier to individuals, small companies and community organisations that wish to implement and use that standard.

4. Open standards are standards which have intellectual property made irrevocably available on a royalty free basis.

This condition is important in order to avoid the risk that corporations with intellectual property interests in a standard wait until the standard has widespread adoption before introducing or substantially increasing royalties.

5. Open standards are standards which as a whole can be implemented and shared under different development approaches and on a number of platforms.

This is the key condition, and cuts to the heart of the reason open standards are needed. Some standards organisations require at least two independent, full implementations of a standard to exist before adopting the standard, and I would commend this approach to the Government.

Standards for computer workstations

Many of the standards listed in this section of the survey are sadly nothing of sort were not open, and many of them weren't standards either. Highlights that I particularly enjoyed included:

The presence of .doc, .xls and .ppt files as a "standard", and inclusion of Microsoft's Office Open XML, which is hardly "open".
HTML as an document format for presentations and spreadsheet data.
A section on video/animation formats that included no open standards whatsoever, and included .swf files (neither open nor standardised) twice.
It was heartening, however, to see Open Document Format listed, along with Unicode and UCS (although why Unicode isn't already mandatory is beyond me).

Beef shin hotpot

2011-03-17T10:25:00.002Z

The cheesecake I described in my last blog post was absolutely delicious!

I enjoy eating beef, but the most well-known cuts are quite expensive. Shin is a less-commonly used cut (you probably won't find it in Sainsbury's), but is still delicious in stews and hotpots as long as you cook it correctly! Ask for it at the butcher or at a farmers' market. Here's a shin hotpot I enjoy making — this recipe serves 4-6.

450 g shin of beef, boned and diced
2 tbsp sherry vinegar
1 tbsp plain flour
6 pork sausages
450 g potatoes
1 dessert (eating) apple
2 tomatoes
1 onion
450 ml beef stock

Put the beef and vinegar in a bowl, and cover with clingfilm. Marinate for an hour, stirring occasionally. This softens and tenderises the meat.

Pre-heat the oven to 160 °C. Thinly slice the potatoes, apple, tomatoes and onion, and cut the sausages into chunks.

Drain the beef, and (optionally) pat it dry with paper towels. Toss the sausage and beef pieces in the flour.

In a large casserole dish, start building the hotpot with layers of sliced vegetables and meat:

1/3 of the potatoes
1/2 of the apple, tomato, and onion
1/2 of the sausages and beef
1/3 of the potatoes
The rest of the apple, tomato and onion
The rest of the meat
A top layer of potatoes (make sure you keep enough back from the previous layers to cover the casserole fully!

Give the dish a little shake to help the casserole settle, and add the stock (it should come about halfway up the casserole).

Cover and cook in the oven for 2 1/2 hours. For the last 10-15 minutes, take the lid off and turn the oven up to 200 °C to allow the top layer of potatoes to crisp up.

Serve in bowls, with plenty of the stock. Leftovers keep really well in the fridge!

Seattle Cheesecake recipe

2011-02-23T16:51:00.004Z

Thanks to one of my colleagues, here's the cheesecake recipe I'm going to try to bake this evening. I've converted the units to metric, scaled the quantities, and added ingredients for a British-style base and an apricot topping.

Start by greasing a 20 cm spring-form tin and lining the base with a round of greaseproof paper. Pre-heat the oven to 160 °C.

Biscuit base

12 digestive biscuits
60 g unsalted butter

Crush the biscuits to the consistency of fine breadcrumbs. Melt butter and mix into crushed biscuits. Gently press mixture into bottom of tin using the back of a spoon to form a level base. Bake for 10-15 minutes until lightly browned and just set. Set aside for at least 5 minutes.

Bottom layer

625 g cream cheese (not reduced fat, premium brand strongly recommended)
140 g caster sugar
3 large eggs
15 ml/1 tbsp vanilla essence

Mix all the ingredients together thoroughly, and pour onto the base. Bake in the oven for about an hour. Time needed depends on atmospheric conditions, but when done the top will start to crack. When done, remove from oven and cool on a cooling rack for 30 minutes. (The cooling rack is important, as you need to get airflow underneath the cake).

Top layer

330 ml sour cream
30 g caster sugar
15 ml/1 tbsp vanilla essence

Turn up the oven to 220 °C. Once the bottom layer is cool, mix the top layer ingredients together, and pour on top. Then return to the oven for a further 10 minutes.

Topping

1/2 jar apricot preserve
3-4 fresh apricots

Slice apricots. Heat jam in microwave for about 45 seconds, until runny, and spread over top of cheesecake. Arrange apricots on top.

I'll update this post later with the results!

Update: This worked out really well! The only slight problem was that the tin didn't come away from the sides totally cleanly, but the cake still looked excellent and tasted delicious!

Open Source in schools — not an idle fantasy

2010-07-06T21:48:00.004+01:00

One of the policies in the Pirate Party UK's general election manifesto this year was:

We will encourage the adoption of open source software in schools, so that children won't be reliant in the future on buying a particular software package from a particular company.

Here in the UK, I still get odd looks when I say I use Linux almost exclusively on my computers. A widely-held perception seems to be that Linux is an esoteric operating system that isn't capable of doing a lot of widely-needed tasks. Certainly many of my friends would never consider running it on their own computers (despite the fact they're almost certain to have at least box running Linux in their house — but I digress).

Open Source in schools is a particularly controversial concept. 'But how will school leavers be able to function in the Real World if they haven't been taught to use the "industry standard" software?' the detractors cry, referring of course to Microsoft Office.

The fact is, though, that Linux has been widely deployed in schools all around the world. The biggest deployment is in Brazil, where the Ministry of Education has installed Linux in labs used by 52 million schoolchildren nationwide — yes, that's fifty-two million — and it's been a great success. Not only does the 'Linux Educacional' distribution, installed in tens of thousands of school computer labs, fulfil the day-to-day needs of school ICT and computer science teaching, but has lead to a growing market for OEM Linux computers in Brazil. And no, their school leavers seem to have no difficulty whatsoever in adapting their IT skills for use in the 'real world' (whatever that is), as Brazil continues to have the strongest IT industry in South America.

Aaron Seigo mentioned this and other (huge!) educational Linux deployments in his keynote speech at this year's Akademy, the KDE developer conference. It seems to me that Linux — not to mention other great Open Source software such as OpenOffice.org, Firefox, Blender, Audacity and Inkscape — have already proven their suitability for use in schools.

Maybe it's time for British schools to step out of the muddy rut of using Microsoft everywhere 'because everybody uses Microsoft', and follow the lead of so many other countries in trying something new, exciting, and in the long run quite possibly both better and cheaper.

Blog migration

2010-03-12T22:13:00.001Z

Since Blogger are discontinuing FTP and SFTP publishing at the beginning of May, I've now migrated my blog to being hosted by a Blogger "custom domain", http://blog.peter-b.co.uk.

Fortunately, I've been able to use a .htaccess file to add a mod_alias Redirect directive that ensures that old links to http://peter-b.co.uk/blog/ will continue to work. So that makes it a lot less of a hassle!

What was a hassle was figuring out the CSS to disable the Blogger navbar, since it completely destroyed the harmony of my site design. It's hard to believe that it's almost seven years old! I should probably break out the text editor and update it at some point, but after this long I can hardly remember how to use CSS and HTML; I've got a lot of catching up to do.

Banana and walnut cake

2010-03-12T20:33:00.004Z

A cake recipe that I've had some success with recently is this rather delicious banana and walnut cake. It's dead simple, and takes very little time to make. There's one in the oven right now!

450 g ripe bananas (weighed before peeling), mashed
125 g unsalted butter
150 g caster sugar
2 large eggs
Half tsp vanilla extract
50 g walnuts, chopped
250 g self-raising flour
Pinch of salt

Pre-heat oven to 180 °C. Lightly butter a 25x10 cm loaf tin. Cream butter and sugar together until smooth and pale.

Add eggs one at a time, beating well. Fold in mashed bananas, vanilla and walnuts. Sift in flour and salt and fold in.

Spoon mixture into loaf tin, and bake for one hour or until a knife pushed into centre of cake comes out dry. Cool in tin for at least 20 min before turning out.

My chocolate brownies have also been popular recently, this time with the University of Surrey Mountaineering Club!

GTK+ no longer supports Windows, apparently

2010-02-20T00:20:00.001Z

When writing computer programs, I try to ensure that they are portable enough to run on as many different platforms as possible without modifying the source code. This becomes tricky when I'm writing in C and I want to provide a vaguely-modern-feeling user interface. Since about 2006, I've relied on GTK+, the basis of the GNOME desktop environment, as my GUI library of choice. A good example of a piece of GTK+-based software for which I'm a member of the development team is the gEDA project, a collection of tools for electronics design.

One of the attractions of GTK+ for me has always been its ability to be used on both X Window System-based operating systems (e.g. Linux and BSD) and on Microsoft Windows. Unfortunately, it seems that Windows support has now been discontinued.

Back in September, GTK+ 2.18 was released. Unfortunately, it contained a large regression which has caused some headaches for people working with GTK+ on the Windows platform (essentially, GTK+ applications would be completely unusable in some cases). Furthermore, a rewrite of some core GTK+ code inbetween 2.16 and 2.18 left the GTK+ on Windows infested with a host of other minor but annoying bugs.

Now, what normally happens when an Open Source program upon which literally thousands of applications and millions of users depend has a major stable release containing a large regression on one of the major supported platforms? Well, in most such cases, the software's developers figure out a workaround as quickly as possible and make sure that those affected know about it, and then make haste to track down the source of the bug, fix it, test the fix, and issue a point release or set of patches with which their users can obtain a working version.

Apparently not so in the case of GTK+. Four months later, GTK+ 2.18.x is still pretty much unusable on Windows, and the general consensus is to use 2.16.x. Dominic Lachowicz, a GTK+ developer, has is still warning people not to use 2.18.x on Windows:

Look before you leap. GTK 2.18 on Windows is very buggy.

The attitude of the maintainer of the Windows port, Tor Lillqvist, has been quite alarming. In comments on the GNOME bugtracker, he gave no impression of any intention of resolving the issues himself, saying:

You want ot use some new API present only in 2.18? Please then consider helping in actually debugging and fixing the problems in GTK+ 2.18 on Windows.

... perhaps you should just use the version of software as it was before the "introduction" of the bug? I mean, nobody promised you there would be any updates of Windows-specific functionality, or otherwise, in GTK+, right? So just use GTK+ as it was before "somebody broke it".

It's becoming distressingly clear that there is no-one in the current GTK+ development team with any particular commitment to keeping the Windows support in working order. Furthermore, it seems clear to me that the hostile and confrontational attitude of people like Tor will tend to drive away any new developers interested in taking the work on. It's already hard enough to get patches into GTK+ as it is -- even complete and tested patches tend to hang around in the GNOME bugtracker for weeks or months before being dealt with.

Going forward, I think that I'll need to find an alternative set of libraries that I can use for cross-platform GUI programming and get a well-integrated 'look and feel' with. The Qt toolkit has a good reputation for documentation and support, but doesn't seem to support applications written in C. Are there any other alternatives I've missed?

Project Postcard

2010-02-01T08:49:00.005Z

I recently wrote a blog posting for the Pirate Party UK website about my latest publicity initiative: Project Postcard!

The election is fast approaching, and the time has come to really press on with raising our profile. All our members need to be doing their part if we're going to make an impact on the UK political landscape. I personally have been aiming to do something meaningful & constructive for the party every day -- and I recommend to you all to make a similar commitment. Even little things can make a real difference.

One way you might be able to help is to get involved with my 'Project Postcard' initiative. I'm shortly going to be ordering a few thousand professionally-produced postcard-like flyers, printed with information on who we are and what we stand for, as well as details of how to find out more.

Read the full article on the PPUK blog.

From the ridiculous to the... even more ridiculous?

2009-11-10T07:41:00.003Z

I've been following the progress of In Re Bilski before the US Supreme Court, because it's got the potential to set the rules for business method (and thus software) patents for the next few years.

Unfortunately, it seems that lawyers' view of what constitutes a "good" patent has hit a new and hilarious low. Take this extract from the oral arguments (thanks to Groklaw for pointing it out):

JUSTICE KENNEDY: But it would be different, it seems to me, than what you are -- let's assume you can't patent an alphabet. I assume that is true. And you can take an alphabet to make beautiful words, and -- and so forth. You -- you want to say that these -- these electronic signals can be used in a way just like the alphabet can be used. And many of the scientific briefs say that their process is different, that they are taking electronic signals and turning them into some other sort of signal. But that's not what you are doing.

MR. JAKES: That may be, but those signals could also be transmitted. On -- on your question about the alphabet you said look at the Morse claim 5, which was an alphabet to Morse Code. That's exactly what it was.

CHIEF JUSTICE ROBERTS: So you reject -- you reject the substitute. You think you can patent an alphabet because it is a process of forming words.

MR. JAKES: It could be, yes.

In what world does this seem like a sane and reasonable way for patentability rules to evolve?

ACTA: write to them!

2009-11-05T12:23:00.002Z

I've now written to both the Green MEP in my region, Caroline Lucas, and my MP, Humfrey Malins.

My e-mail to Caroline Lucas was fairly straightforward to write. Firstly, she's an MEP, and thus European-level matters are more directly relevant to her interests. Additionally, the Commission have been ignoring direct calls, by MEPs, lead by the Green Party, for more transparency in ACTA, so I know that she already agrees that there's a problem.

Dear Dr. Lucas,

In December 2008, lead by the Green Party, the European Parliament adopted a resolution regarding ACTA which:

"... Calls on the Commission and the Member States to negotiate ACTA under conditions of the utmost transparency towards EU citizens, especially with regard to the definitions of the terms "counterfeiting" and "piracy" and the criminal sanction measures foreseen; takes the view that the social impact of the agreement as well as the impact on civil liberties must be assessed; supports the establishment of a task force to examine the implementation of the agreement, by promoting this subject in dialogue between the European Union and third countries and as part of cooperation measures with those countries..." [P6_TA(2008)0634]

Furthermore, in March 2009, the Parliament and Council adopted a Regulation that required that:

"In accordance with Article 255(1) of the EC Treaty, the Commission should immediately make all documents related to the ongoing international negotiations on the Anti-Counterfeiting Trade Agreement (ACTA) publicly available. [Am 109]" [P6_TA-PROV(2009)0114]

Nevertheless, many months later, the ACTA text under discussion is still being discussed behind closed doors, without the opportunity for review or discussion by those whom it will affect if adopted. I would greatly appreciate an explanation as to why this is, and what the Parliament, the Green Party and you yourself are currently doing to address this.

Yours sincerely,
Peter Brett

Writing to Humfrey Malins was more challenging. Firstly, European Commission-level negotiations aren't something that the Commons has any real direct influence on. However, the fact that the Baroness of Uphallow is the European Commissioner for Trade provided a way to demonstrate the ACTA negotiations' direct relevance.

Dear Humfrey Malins,

The UK, as part of the European Commission, is currently in the process of negotiating the plurilateral Anti-Counterfeiting Trade Agreement.

This process has been concealed behind a veil of utmost secrecy, despite repeated demands by the European Parliament and Council for greater transparency (see: P6_TA(2008)0634 and P6_TA-PROV(2009)0114). Only a rough outline of the structure of the proposed treaty is available to the billions of people who will be affected by its provisions. I do not believe that, in the case of a trade treaty, such secrecy serves the public interest. The quality and fairness of the results of the process can only be improved by allowing the people in whose name the treaty is being negotiated to see and discuss the actual provisions being suggested.

I have already written to my MEPs, but the Commission has made it quite clear that they intend to continue to ignore the European Parliament's position on this issue. Catherine Ashton is the UK Commissioner and holder of the Commission's Trade portfolio, and as such is responsible for the Commission's role in the ACTA negotiations. (It is interesting to note that the Baroness of Upholland has no background in trade issues and has never been elected to public office.)

Would you be willing to ask the Prime Minister to direct Baroness Ashton to encourage the EU ACTA delegation to open the process to public scrutiny, please? It seems to me this would greatly serve the public interest.

Yours sincerely,

Peter Brett

Hopefully I'll get some useful and timely replies. We'll see!

Peter Brett's Blog

Paper for EUSAR 2012

Coming up to gEDA 1.7.2

Scheme API merge, and keybinding in gschem

The gEDA Scheme API manual is here

gEDA and Guile — opportunities to get involved

gEDA and Guile — reducing boilerplate with "snarfing macros"

Why is "snarfing" needed?

The guile-snarf tool

Conclusion

gEDA and Guile — how and when to use Scheme errors

When to raise Scheme errors

How to raise Scheme errors

Conclusion

gEDA and Guile — checking arguments to Scheme functions in C

Using SCM_ASSERT()

Don't leak resources!

Conclusion

gEDA and Guile — dealing with deprecated libguile functions

Getting notified about deprecated API usage

The problem with SCM_STRING_CHARS() and SCM_SYMBOL_CHARS()

Replacing SCM_STRING_CHARS()

Replacing SCM_SYMBOL_CHARS()

Conclusion

gEDA and Guile — safe handling of non-local exits

What are non-local exits?

Dealing with non-local exits safely

Conclusion

gEDA and Guile — compiling against multiple Guile versions

Installing & setting up Environment Modules

Creating modules for Guile versions

Putting it all together

gEDA and Guile — finding Scheme API code in gEDA

What is Scheme used for?

Where is the Guile code in gEDA?

Porting gEDA to Guile 2.0, and future plans

Papers presented at JURSE 2011

Weekly News Stash

Libya and Wikileaks

Engagement with the Liberal Democrats

In academia

In the courts

Survey on "Open Standards in the Public Sector"

What is an open standard?

Standards for computer workstations

Beef shin hotpot

Seattle Cheesecake recipe

Biscuit base

Bottom layer

Top layer

Topping

Open Source in schools — not an idle fantasy

Blog migration

Banana and walnut cake

GTK+ no longer supports Windows, apparently

Project Postcard

From the ridiculous to the... even more ridiculous?

ACTA: write to them!

The `guile-snarf` tool

Using `SCM_ASSERT()`

The problem with `SCM_STRING_CHARS()` and `SCM_SYMBOL_CHARS()`

Replacing `SCM_STRING_CHARS()`

Replacing `SCM_SYMBOL_CHARS()`