Wednesday March 21, 2007 Just some notes on porting Racoon to OpenSolaris that might be useful for any Google Summer of Code student who gets assigned to that project.
The first hurdle is the simple naming of some types, the Racoon code for some reason uses u_int32_t instead of uint32_t after running configure add the following to config.h:
#ifndef __P
#ifdef __STDC__
#define __P(p) p
#else
#define __P(p) ()#endif
#endif /* !defined(__P) */
#define u_int8_t uint8_t
#define u_int16_t uint16_t
#define u_int32_t uint32_t
#define u_int64_t uint64_t
Raccoon seems to assume that the host has the KAME policy extensions available, OpenSolaris doesn't have this. Instead we have <sys/pfpolicy.h> so Racoon needs to be ported to the OpenSolaris PF_POLICY system.
Getting GSSAPI support working would also be very good. The configure script trips on because the OpenSolaris /usr/bin/krb5-config script doesn't have an option for GSSAPI.
The rest is well thats up to whom ever picks up this project :-)