Planet FreeBSD Summer of Code 2008

Przemek Witaszczyk: WANTED: PIC driver...

2008-08-27T07:01:00+00:00

Finally, I've managed to fix all (at least up till now..) broken OF calls, and the kernel went further, to the place where devices are attached. Among them, there should be a PIC driver, which is missing... After adding the ofwbus driver which I got from Andrew, I've constructed a PIC driver skeleton from the sys/powerpc/powermac/hrowpic.c. The PIC was found to resist on the ofwbus3, and the attch method fails to allocate memory (nice screenshot on my wiki http://wiki.freebsd.org/Porting_FreeBSD_to_Efika_(PPC_bring_up)). Now I have to mutate the old mac driver to obey the mpc5k2 will... I've also created a new folder in the p4 branch, where all the stuff concerning MPC5200B will be stored. It's called ... mpc5k2 :)

Przemek Witaszczyk: Staying late pays...

2008-08-19T18:52:00+00:00

Thanks to simple, yet great advice by Andrew Turner concerning calls to openfirmware and utilizing *OF_buf, it seems that eventually I came to the point where the kernel panics due to the lack of PIC!:

===================

atomic_subtract_16(0)... panic: no PIC detected

KDB: enter: panic
[thread pid 0 tid 100000 ]
Stopped at 0x29587c: addi r0, r0, 0x0

===================

As you can see, the KDB by itself stops at this point, no crash at last:)

All thanks to the AT and the fact that I'm studying hard for the exam (Quantum Mechanics for PhD students....)

Przemek Witaszczyk: /decr_init()/

2008-08-19T06:54:00+00:00

Some new things came up recentrly, I've added some code from NetBSD and commented out the decr_init() in cpu_startup(). Now, during the boot I've rached subsystem 3800000 , as last time w/o decr_init(), but this time it seems it entered the newbus!

==========================================

[thread pid 0 tid 100000 ]
Breakpoint at 0x4930d8: stwu r1, r1, -0x20
db>
nexus0: registered as a time-of-day clock (resolution 1000us)
nexus0: , type (unknown) (no driver attached)
nexus0: , type (unknown) (no driver attached)
nexus0: , type (unknown) (no driver attached)
nexus0: , type (unknown) (no driver attached)
nexus0: , type (unknown) (no driver attached)
nexus0: , type memory (no driver attached)
nexus0: , type (unknown) (no driver attached)
nexus0: , type (unknown) (no driver attached)
nexus0: , type serial (no driver attached)
nexus0: , type builtin (no driver attached)
nexus0: , type pci (no driver attached)
sc0: no video adapter found.
nexus0: , type syscons (no driver attached)
done.
ofw_bus_gen_get_name(0)... cpu_exception:
SRR0 0x01035CFC SRR1 0x00003030 MSR 0x00003030
LR 0x0103E1E4 CTR 0x0101A5F0 CR 0x44002042 XER 0x20000000
DAR 0xD0004DDE DSISR 0x42000000 Type 3
GPR[] 0x00000007 0x00559EB4 0x00000000 0x00000000 0x07C05323 0x00000005 0x0000000D 0x0058EBB8

...

============================================

And again, the old friend. I can't spot the cause of those crashes. They always look the same, with the same content of SRR0,1 and MSR. Adding some stuff from NetBSD helped, but it only took it just a few steps further. Thus it must be something wih the OF, but what? This time it's nothing about the stack, because the registers contains some crazy addresses, neither form kernel, nor from the OF stack... During some previous tests I've encountered some crashes on instructions reading/writing to SPRG0 and IBAT4, in ofw_sprg_prepare(); and in

===========

from: src/sys/powerpc/aim/ofw_machdep.c

__asm __volatile( "\t"
"sync\n\t"
"mfmsr %0\n\t"
"mtmsr %1\n\t"
"isync\n"
: "=r" (oldmsr)
: "r" (ofmsr[0])
);
============

both in openfirmware()...

Ryan French: Final Summer of Code Report

2008-08-18T23:21:26+00:00

Summer of Code has now officially finished. Well, at least the coding part of it has. This is my final GSoC report, but hopefully will not be my last post here. As it stands at the moment, I have not managed to get sending and receiving working, but I am very close to it. I honestly am unsure as to why it is not working, but I believe it may be to do with how I have tied my code into the kernel, and I dont think it is getting initialized or compiled with the right preprocessor defines or something. However, I will still be working on getting this going, as not only is it my dissertation for university this year to do this, but it has become somewhat of a personal challenge to prove to myself that I can do it.

With that in mind I will keep on working on this at every oppurtunity I get, and will definately have at least sending/receiving working by October, which is when the dissertation is due. So here is a run down of what I have accomplished so far for the GSoC, and what I plan to implement in the future.

Accomplished:

MPLS-needle - this is a small tool I built for testing of MPLS. It takes a configuration file and uses that to define and build an MPLS packet, which is then inserted onto the networking stack using a BPF device.

Basic port of OpenBSD/Ayame code - I have been working solidly for the last few months on porting the OpenBSD code, which is based on Ayame, to FreeBSD. This was a much bigger task than I orginally intended. As I have had no previous experience with kernel coding this has involved a huge learning curve, not only in just kernel coding itself, but in how the FreeBSD networking code works, and how it differs to OpenBSD (by the way, it is a lot more than I thought it would be). The code has been ported over and changed accordingly, but still does not work. However, the kernel does compile and run, it just appears that the MPLS code does not run when a packet is received. I think this is because of incorrect #defines, as I’m not entirely sure where I need to define these (in the Makefile or somewhere in my code). I will continue to work on this and attempt to get it working asap.

Future Plans:

Once basic sending/receiving is acheived, I will be attempting to implement the following features. I believe this will be a lot easier as I will be working mostly on my own code, independant of the kernel code itself, but I have been known to be wrong before.

Routing Table Manipulation - create a way to store, insert, edit and delete MPLS routes in a table.

Static Label Switching - being able to receive a packet, swap the label, and send it out using a statically defined route in the routing table.

LDP Implementation - implement the LDP daemon for autmatic label distribution and routing table building.

Tunnels - implement MPLS L2 and L3 tunnels with first virtual interfaces, and then real interfaces.

At least thats the plan for now, and I’m really hoping that it becomes a reality.

I would like to take this chance to thank everyone that has helped me through this transition into kernel hacking and opensource hacking. It has been a lot of fun, with a lot of frustration, but very much worth it. If anyone would like to take a look at my work and provide some feedback, whether it be stuff I need to change, or help on completing my goals, it would be welcomed and very much appreciated. The code can be viewed here on Perforce.

Thank you

-Ryan French.

Przemek Witaszczyk: odd discovery

2008-08-17T17:41:00+00:00

I was fighting with the OF_peer() to check if it passes the openfirmware() call, which is OF entry and after lots of tries it seems that it does. It's very different from what I thought before. After using ofw_stack() from NetBSD in OF_peer() as it was done in OF_read()/OF_write(), that function seems to be working but the crash remains.

Here's the dump:

DEBUG 2
done.
subsystem 2100000
freebsd4_sigreturn(0)...
cpu_startup() DEBUG 0
** DEBUGL OF_printf(): after OF_peer() in decr_init()
cpu_exception:
SRR0 0x004A0DF0 SRR1 0x00003030 MSR 0x00003030
LR 0x01003ED8 CTR 0x00000000 CR 0x24002044 XER 0x0
DAR 0xD0004D3C DSISR 0x42000000 Type 3
========================
What is very strange, during the trace I've encountered the call to OF_write() just after OF_peer(), like there were _two_ calls to openfirmware() insted of one. And it's the second one that crashes... Now, what I don't get is where from this second call come ? There's no printf() around OF_peer()...:

========================

from: sys/dev/ofw/openfirm.c

phandle_t
OF_peer(phandle_t node)
{
static struct {
cell_t name;
cell_t nargs;
cell_t nreturns;
cell_t node;
cell_t next; }

args = {
(cell_t)"peer",
1,
1,
};

ofw_stack();
args.node = node;
if (openfirmware(&args) == -1)
return (-1);
return (args.next);
}
=========================

Vincenzo Iozzo: Final results

2008-08-16T19:08:17+00:00

Hi all, it has been a long time since my last post. Due to some problems I didn’t have the chance to update this blog. Anyhow before the end of the soc, I’m here to speak about what I did in this period.First of all my auditpipe patch changed a bit: it supports only pid-based subscription to events due to internal decision taken by me and other developers. How to use it then?
fd = open(”/dev/auditpipe”, O_RDONLY);
if (fd < 0)
err(-1, “/dev/auditpipe”);

entry = malloc(sizeof(struct auditpipe_ioctl_preselect_proc));
if(entry == NULL)
err(-1, “MALLOC”);

value = AUDITPIPE_PRESELECT_MODE_PROC;
if (ioctl(fd, AUDITPIPE_SET_PRESELECT_MODE, &value) aipp_pid = pid;

if (ioctl(fd, AUDITPIPE_SET_PRESELECT_PROC, entry) < 0)
err(-1, “AUDITPIPE_SET_PRESELECT_EVENTS”);

What it does is to open auditpipe, change the preselection mode to AUDITPIPE_PRESELECT_MODE_PROC and set up an entry with a specific pid. From there on auditpipe will trace that specific pid. Clean and concise:P Now the second half of the project. I ought to write a regression test framework. After several unsuccessful attempts, I figured out how to make it works with a bit of shared memory. The general idea is to have a testing function/process which communicates with a parent process and exchange runtime information in order to run the test. The testing function will take read records from auditpipe and compare them with runtime information collected before. If some inconsistencies are found they are reported. More in details, here is a sample testing module:
/*-
* Copyright (c) 2008 Vincenzo Iozzo
* All rights reserved.
*
* Redistribution and use in source and binary forms, with or without
* modification, are permitted provided that the following conditions
* are met:
* 1. Redistributions of source code must retain the above copyright
* notice, this list of conditions and the following disclaimer.
* 2. Redistributions in binary form must reproduce the above copyright
* notice, this list of conditions and the following disclaimer in the
* documentation and/or other materials provided with the distribution.
*
* THIS SOFTWARE IS PROVIDED BY THE AUTHOR AND CONTRIBUTORS “AS IS” AND
* ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
* IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE
* ARE DISCLAIMED. IN NO EVENT SHALL THE AUTHOR OR CONTRIBUTORS BE LIABLE
* FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL
* DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS
* OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION)
* HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT
* LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY
* OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF
* SUCH DAMAGE.
*
*/

#include “audit_pipe_regression_test_utils.h”

struct sysctl_record
{
int mib[6];
char err_val[256];
int ret;
int index;
struct sysctl_record *next;
};

struct sysctl_record *
add_field(struct sysctl_record *head, struct sysctl_record *new)
{
struct sysctl_record *tmp;

tmp = head;
if(tmp == NULL) {
new->next = NULL;
return (new);
}

/* Reach the last element of the list*/
for(; tmp->next != NULL;tmp = tmp->next);

new->index = tmp->index +1;
tmp->next= new;
new->next = NULL;

return (head);
}

void test_sysctl()
{
int mib[2];
int ret, val;

init_channel_primary();

mib[0] = CTL_KERN;
mib[1] = KERN_SECURELVL;
val = 2;
ret = sysctl(&mib, 2, NULL, NULL, &val, sizeof(int));

write_int(mib[0], “arg”);
write_int(mib[1], “arg1″);
write_int(ret, “ret”);
if (ret == -1)
write_string(strerror(errno), “ret_val”);
else
write_string(”success”, “ret_val”);
write_end();

val = 1;
ret = sysctl(&mib, 2, NULL, NULL, &val, sizeof(int));
write_int(mib[0], “arg”);
write_int(mib[1], “arg1″);
write_int(ret, “ret”);
if (ret == -1)
write_string(strerror(errno), “ret_val”);
else
write_string(”success”, “ret_val”);
write_end();

end_channel();

/* Let auditsysctl flush all data */
sleep(5);
return;
}

void validate(FILE *f, struct sysctl_record *head, char *path, pid_t pid)
{
int i, ret, reclen, bytesread, to_parse, arg_counter;
struct sysctl_record *tmp, *elem;
int err = -1;
tokenstr_t tok;
u_char *buf;
u_char type = 0;
FILE *fp;
long control_flag;

to_parse = WAITING;
arg_counter = 0;
control_flag = 0;

fp = fopen(path, “r”);
if(fp == NULL)
return;

tmp = head;
if(tmp == NULL)
return;

while(1) {

to_parse = WAITING;
if(!err || reclen == -1)
break;

/* Record must begin with a header token. */
do {
type = fgetc(fp);
} while(type != AU_HEADER_32_TOKEN);
ungetc(type, fp);

while ((reclen = au_read_rec(fp, &buf)) != -1) {
bytesread = 0;
while (bytesread mib[0]);
else
ret = check_arg(tok.tt.arg32, tmp->mib[1]);

if(!ret)
report_error(tok, f);
break;

case AUT_RETURN32:
TOKEN_FLAG_SET(control_flag, TOKEN_RETURN);
ret = check_ret(tok.tt.ret32, tmp->ret, tmp->err_val);
if(!ret)
report_error(tok, f);
break;

case AUT_TRAILER:
to_parse = WAITING;
if(!TOKEN_FLAG_ISSET(control_flag, TOKEN_SUBJECT))
report_error_string(”Missing Subject token”, f);
if (!TOKEN_FLAG_ISSET(control_flag, TOKEN_ARG) || arg_counter != 2)
report_error_string(”Missing Argument token”, f);
if(!TOKEN_FLAG_ISSET(control_flag, TOKEN_RETURN))
report_error_string(”Missing Return token”, f);
control_flag = 0;
arg_counter = 0;
if(tmp->next != NULL)
tmp = tmp->next;
break;

default:
break;
}
}
}
}
}

free(buf);
fclose(fp);
}

int
main(int argc, char *argv[])
{
int i, quit, fd, value, index, fdout, count;
char *shared_string, *descr, path[512];
pid_t pid;
struct sysctl_record *head, *elem;
FILE *f;

index = 0;
head = NULL;

init_channel();

pid = fork();
if(!pid) {
sleep(15);
test_sysctl();
} else {
fd = setup_auditpipe(pid);
snprintf(path, 512, “/tmp/audit-%d”, pid);

fdout = open(path, O_RDWR | O_CREAT);
if(fdout == -1)
err(-1, “OPEN”);

quit = 0;
while (!waitpid(pid, &quit, WNOHANG)) {

/* Audit pipe input. */
read_auditpipe(fd, fdout);

/*
* See whether is there anything on the shared-memory,
* if so build a structure
*/
sem_getvalue(mutex, &count);
if(count) {
shared_string = read_string();
elem = malloc(sizeof(struct sysctl_record));
if(elem == NULL)
err(-1, “MALLOC”);

while((count = parse_string(shared_string)) != -1) {
descr = get_descr(shared_string);
if(count == INT_TYPE) {
if(!strncmp(descr, “arg1″, 4))
elem->mib[1] = get_int(shared_string);
else if (!strncmp(descr, “arg”, 3))
elem->mib[0] = get_int(shared_string);
else
elem->ret = get_int(shared_string);
}
else if ( count == STRING_TYPE) {
snprintf(elem->err_val, sizeof(elem->err_val) >
strlen(shared_string) +1 ?
strlen(shared_string) +1 :
sizeof(elem->err_val), “%s”,
shared_string);
}
shared_string = read_string();
}
head = add_field(head, elem);
if(head == NULL)
err(-1, “List error”);
}
}
}
close_auditpipe(fd, fdout);
end_channel();
f = init_log(pid);
validate(f, head, path, pid);
fclose(f);
return (0);
}

As you might see, the validate() function will compare records against collected data, whereas the test_sysctl() will send to the parent, using shared memory, information regarding the events. You might see a sort of ”API” here, those functions were provided in order to ease tests writing. They are somehow commented, so you might find useful to take a look at the code. I wrote tests for 20 events, but theoretically they are 500+, so we need your help. As usual if you have any kind of suggestions or comments feel free to contact me. Here: http://www1.autistici.org/snagg/final.zip you can find the whole code. Cheers,Snagg

Anders Nore: Nearing end, call for testers

2008-08-16T17:50:36+00:00

Hi, it’s nearing the end of GSoC 2008 and I’ve updated my wiki ( http://wiki.freebsd.org/AndersNore/pkg_improved ) about the pkg_improved project and there are testing instructions for those brave enough. Please test and please report bugs. There are several new features to the pkg-tools and there are some speed improvements made. Lately I’ve been cleaning some of the code mostly fixing bugs and writing documentation in the form of man-pages.

Przemek Witaszczyk

2008-08-16T06:32:00+00:00

I've tried to find the differences between the contexts of calling openfirmware()
from OF_write()/OF_read() and OF_peer(), but I found none. It's not possible
to break into the fwentry() call from openfirmware(), since it always results in
spinlock corrupt crash. I've tried to insert the call to decr_init() into several
boot subsystems, it always ended with the same crash, even before the VM init.
I've also called the OF_peer() at the very beginning of OF_write() to see if it's
possible to execute it at the very early stage of the boot, before the KDB entry.
It crashed. I've also tried to switch off the decr_init() call in the cpu_starup() and the system passed several following subsystems to subsystem 3000000 (or so) and crashed in the same way it does with decr_init().
I've inspected what does the ofw_stack() function do, but it only copies the current call stack to the firmware stack located in locore.S. This call was added in OF_read()/write() to make them work on Efika. Now, I can guess it's something with what could have change in p4 FBSD vs FBSD 6.x, since the patch was for that version. I'll try to apply the patch to version 6.x. Also, I'll have a look at the NetBSD source. I really don't understand, why it does work work the OF_read()/OF_write() and does not for OF_peer(), since those calls are so similar.

Przemek Witaszczyk: still no luck, and a new problem

2008-08-08T15:28:00+00:00

I've performed lots of experiments with the ofwreal.S and locore.S
sources in aim to try to remove the problem with the stack.
It does't work for now, but I've managed to overcome that by utilizing
some free registers. Now I've encountered yet another problem - the
kernel now crashes on the openfirmware entry in the fwentry(). It's probably
coused by a wrong address of the entry point, coming from the virtual
instead of the real addressing. Here's the crash site:
=============
cpu_exception:
SRR0 0x00000000 SRR1 0x00083030 MSR 0x00003030
LR 0x004A0E70 CTR 0x00000000 CR 0x44002082 XER 0x20000000
=============
I've made a small test by changing the address the firmware entry is supposed to
be at and I get slightly similar crash:
=============
cpu_exception:
SRR0 0x01003ED8 SRR1 0x00003030 MSR 0x00003030
LR 0x004A0E70 CTR 0x00000000 CR 0x44002044 XER 0x0
=============
The LR's point to the same location, the very next instrucion after branch to OF.
So I suppose it's the OF address, not just the argument addresing
that is responsible at the moment. I'm trying to find out how to translate an
address to the real mode. All help would be greatly appreciated...:)

Konrad Jankowski: Enter Libc

2008-08-05T11:55:39+00:00

I spend last weeks on importing interesting parts of Apple’s libc to FreeBSD. I ended up with this patch: http://versus.ath.cx/patches/fbsd_7.0_collation.patch, which I than applied to the CURRENT libc, and commited as my p4 libc branch.

It wasn’t however without accident - I suffered two serious laptop breakages, ending with en essentially dead one. First the display broke down - stopped showing anything - I think it was the backlight. I was lucky - I had external monitor enabled and configured for Dual Head. When I connected it however, I started to get IDE timeout problems when booting FreeBSD. So my hard drive also died. I managed to boot off live-cd, and copy and my gsoc data, and that was it.

After installing everything on my new-bought laptop, I got to finishing my work on libc, and was able to get in into - I think - fully working state. There are still some little things I want to fix/enhance, but general functionality is there.

Now I’m focusing on writing regression tests, than will come manpages. At the end will be a call for testers.

Ryan French: Weekly Report - 4/8/08

2008-08-03T23:52:07+00:00

I managed to get a few things done this week which and spend a few hours going over FreeBSD networking code and making changes to my own code. I am very close to being able to get the basics of MPLS going, and once that is done the more advanced features will actually be a bit easier as I have the Ayame project to reference those off, whereas at the moment I have no real reference material on how to integrate my MPLS code with the FreeBSD networking code. As I said last week, if anyone has any advice or experience on how to get netisr calling my MPLS code, I think I almost have it, but it would be hugely appreciated as it will save me precious time that I dont really have. I realised this weekend that there is only a month till the end of the Summer of Code, at which point I really need to have at least simple sending/receiving and basic label switching going. Luckily, I am also doing this project as a dissertation for my Post Graduate Diploma in Computer Science this year, so I will be working on it for at elast another month after the summer of code stuff has finished, and I plan on getting a fully working implementation of MPLS going for FreeBSD eventually by completing it once I leave university.

Accomplished Last Week:

- Went through the FreeBSD networking code, trying to figure out where abouts the actual call to the protocol initialising functions are made. It’s not as easy as you would think for someone with almost no previous Operating System code experience to look at this stuff and try and figure it all out, but I’m getting there.

- Made some changes to my own code to use the FreeBSD specific networking routines, rather than the OpenBSD ones, particularly involving if_ethersubr.c and the netisr files.

Plans for Next Week:

- Finally finish figuring out where I am to call the mplsinitr function and getting the protocol registered with netisr. I’ve said this many times before, and it keeps elluding me, but basically once this is done then the protocol will have a basic functionality and I can actually be semi-happy with the work I have accomplished.

- Figure out what feature is more important to concentrate on next. With so little time remaining in the GSoC I am wanting to make sure I have gotten as many features of the protocol implemented as I can, but I want to make sure I have all the key features that I need implemented as well.

Anders Nore: New pkg_info -M (installtime comparison)

2008-08-03T22:23:06+00:00

Now the new date feature is doing something useful, I’ve added an option (-M) to pkg_info which compares installtimes of packages similar to the comparison of versions. So now you can do “pkg_info -M ‘*>2008 07 18′ ” and it will display all pacakges installed after the date YYYY MM DD, you can also use the -x or -X option with the -M option. I’m also planning to make use of this in pkg_delete so you can delete packages within date-ranges. Also pkg_convert will have an option so you can make the installtime of packages (who do not have a @comment DATE field) equal e.g., to the changetime of +DESC in /var/db/pkg/pkgname/ (which is correct for most packages). I’ve also decided to cache the installtime which makes this operation a lot faster than calling read_plist for every package to find the installtime.

I’ve also done some improvements to the ‘pkg_add -r’ progress indication output, which now displays the speed of the download as well as percentage progress.

Przemek Witaszczyk: hard progress

2008-08-01T07:29:00+00:00

Eventually, with the aid of my mentor, we found the exact position of the faulting instruction. I've managet to turn on the KDB facility and thus we were able to make some breakpoints. In aim to spot the bug we used the DAR register content and toolchan version of the objdump tool. Fortunately, it appeared that addresses obtained from the objdump and those from the running kernel match. Here's the dump:

====================================================================

...

SRR0 0x004A0D10 SRR1 0x00003030 MSR 0x00003030
LR 0x01003ED8 CTR 0x00000000 CR 0x24002044 XER 0x0
DAR 0xD0004D3C DSISR 0x42000000 Type 3
GPR[] 0x004A0BC4 0xD0004D30 0x00000000 0x01003ED8 0x00003030 0x00000000 0x00000020 0x00000000
...

====================================================================

The evil instrucion is in the openfirmware entry point wrapper,

====================================================================

ofwreal.S

...

/*
* Emulated firmware entry.
*/
fwentry:

...

lis %r3,clsave@ha /* save mmu values of client */
addi %r3,%r3,clsave@l
lis %r3,fwsave@ha /* restore mmu values of firmware */
addi %r3,%r3,fwsave@l
bl restoremmu

lis %r3,ofentry@ha
lwz %r3,ofentry@l(%r3) /* get actual firmware entry */
mtlr %r3

mfmsr %r4
stw %r4,12(%r1) /* save MSR */
ori %r4,%r4,PSL_IR|PSL_DR /* turn on MMU */
andi. %r4,%r4,~PSL_EE@l /* turn off interrupts */
mtmsr %r4
isync

====================================================================

The problem is with the stack,

stw %r4,12(%r1) /* save MSR */

That line causes probably a DSI exception. The problem is that it crashes just after the restoremmu function branch. If one stores something on the stuck before that branch, ther's no crash. So the problem lies in the restoremmu function, but it's not clear to me where exactly it is, because the restoremmu does not operate the %r1 register explicitly.

Gleb Kurtsou: Layer2 filtering in pf

2008-07-30T10:16:34+00:00

Instead of trying to describe all the changes regarding layer2 filtering in pf I’d better provide some examples.

Ethernet address can be specified for host or interface name:
pass in on bridge0 from 10.0.0.1 ether 00:11:11:11:11:11 to 10.0.0.2 ether 00:22:22:22:22:22 pass in on bridge0 from ($int_if:network) ether 00:11:11:11:11:11 to any

Ethernet addresses are supported in table entries:
table <test> persist {10.0.0.1 ether 00:11:11:11:11:11, 10.0.0.2 ether 00:22:22:22:22:22} pass on bridge0 from <test> to <test> keep state (ether)

Ethernet stateful filtering is handled specially. Per rule flag is added to conditionally enable ethernet stateful filtering (disabled by default):
pass log on bridge0 from <test> to <test> keep state (ether)

With keep state (ether) enabled pf uses real source and destination ethernet addresses from the first packet to create the state and uses these addresses afterwards to match the state.

Gábor Kövesdán: BSD grep - Part 2

2008-07-28T15:30:00+00:00

I’ve fixed the known issues with BSD grep and rewritten some parts as my mentors suggested. Now I’m waiting for his answer about the current code and if he thinks it’s ok, I’ll submit it to portmgr@ for a thorough test. The last time grep failed on pointyhat due to a bug in -v.

As for BSD diff, I have completed some features, but still there are various to implement. The current status can be seen here.

Rui Paulo: tcpad status report #3

2008-07-28T12:56:15+00:00

So, I’ve been offline for some days now and I’ll continue to be until the end of the month. Development of tcpad is going fine and I just committed a few days of work into Perforce. This new work includes parsing of the TCP options and further SEQ/ACK analysis.
SEQ/ACK analysis is probably the most challenging task of this project, so it hasn’t been finished yet.
The good news is that I’m learning a lot about TCP and its extensions and it’s being thrilling!

In other news, my TCP ECN work will most likely be committed to FreeBSD-CURRENT RSN.

Ryan French: Weekly Report - 24/7/08

2008-07-24T00:13:17+00:00

So university is already in it’s second week down here in New Zealand, and things are already getting underway, with my first assignment due today. I’m taking some “interesting” papers this semester. Operating Systems will be really good, as we are learning how to write Linux modules, and we in fact are going to write a file system for Waikato Universities “unique” cluster computer (it has been described as just an office network running fancy software, and in fact it is pretty much just a bunch of Dell computers on an ethernet network), with the main focus being something that supports migration from one node’s hard drive to another. Advanced Communications may or may not actually help me in the real world, I’m not sure, but it’s all just to do with carrier networks and setting up/maintaining a network in a workplace or ISP. For fun I decided my last paper to be “Graphics and Computer Games”, which focuses more on graphics than anything, using C# and Microsofts (sorry for saying a dirty word) XNA package. Sadly, I’m actually already a huge fan of XNA after only a week. I’ve already gone from no previous knowledge to having 3D models loaded on the screen and letting the user control the camera. Yes its that easy.

The Goggle Summer of Code midterm evaluations have been completed, and I passed, despite being able to work much on MPLS for the past while, and not being as far through the project as I had hoped, but thanks to the money I have now been able to cut 2 or 3 days a week off my work at the liquor store, so I can concentrate more on getting this project working. Also, I got myself a 26″ Viewsonic screen.

On to the report.

Accomplished Last Week:

- With the normal start of semester stuff going on I wasnt able to do much more on MPLS, other than try to sort out where I am supposed to call my mplsintr function from. In OpenBSD this is done directly inside netisr, but in FreeBSD this is not the case. If anyone has any ideas on this please leave a comment as it would save me a lot of time.

Plans for Next Week:

- I have the next 2 days off with no work and no uni, so depending on how much work my lecturers gve me today I will have at least 1 full day to work on MPLS. I am hoping to figure out the netisr problem and have the port completely finished by Sunday.

- Work out my next step and where the port has left me. As far as I can tell, once the port from OpenBSD is done I will be able to send and receive MPLS packets, and switch the label based on a table that is manually setup using the route command. From there I would like to look at setting up automatic route table stuff, using Ayame’s MPLS-TE code as a basis, but it might turn out that there are more pressing features of MPLS that need my attention.

Anders Nore: New features

2008-07-21T17:56:42+00:00

Hello, it’s been a while since I’ve updated my blog and it was about time. I’ve come back from my vacation this week and I have added two new features to pkg_improved which I think are nice features to have.

The first feature is that pkg_add registers the installation time (seconds-since-epoch) in +CONTENTS as a “@comment DATE: 123124124″, pkg_info can then see the installation dates of installed ports with the new -n option (for viewing the date in human readable form) or with the -N option (prints out seconds-since-epoch). The reason why I added this is because I’ve seen people ask how they can get the installation time of packages, and in my opinion I don’t think that the filesystem should be the only holder of such information (e.g. fetching modification time of files contained in /var/db/pkg/*).

The second feature is dependency fixing (I’ve seen that portmaster does this), and what it does is to reconstruct the +REQUIRED_BY file for packages being installed with pkg_add or when pkg_create -O option is called from ports. In detail it checks every installed package for a @pkgdep that matches the installing package it add’s it to the installing package +REQUIRED_BY file. This slows down pkg_add somewhat but I think this should be the correct behaviour for pkg_add.

I’ve also added a percentage progress status to pkg_add -r (remote fetching packages). You can see instructions for testing the improved tools on my blog: http://wiki.freebsd.org/AndersNore/pkg_improved

Ryan French: Weekly Report - 17/7/08

2008-07-16T23:42:43+00:00

Haven’t done one of these for the past two weeks, due to a very hectic holiday travelling to a few different places to catch up with friends and family while I still had a chance.

Accomplished Last Week:

- Began porting over the Ayame/OpenBSD code to FreeBSD. The problem I’ve come across at the moment is in the differences between OpenBSD and FreeBSD in terms of the netisr stuff. I’m looking into at the moment and should hopefully have it done soon.

- Turned 24. For those of you who know me, you’ll realise that it was quite an accomplishment for me to make it this far through my life and still be alive.

- GSoC midterm evaluations were submitted, only 6 weeks left in the program.

Plans for this week:

- University has started up again for me, and its straight back into it. Luckily it looks like I’m going to be able to work a few less days a week thanks to my GSoC money and having my work employ a few new people, so I should be able to devote a few more days a week to MPLS.

- Finish porting over the OpenBSD code. This will mean I will be able to send and receive MPLS packets, using labels that can be manually entered using the route command. I have to still look into the code a bit more to decipher if the label switching is doing everything I was planning on implementing with it.

Konrad Jankowski: Reinforcements from Apple

2008-07-12T15:45:36+00:00

Last time I said that it would be nice to use some Apple’s work in the area of collation. I exchanged a few emails with Jordan K. Hubbard and it seems we can user their code without problems - all interesting parts are still on the BSD licence. That’s because this is still our code, only extended by Apple. Even the copyrights weren’t changed a bit (so we don’t know who did the extending).

Anyway, as the code is fairly mature, I decided to use it. The libc part of the code is the one I am most interested in, but to see how it works, I first had to port the userland tool - Apple’s version of colldef. Doing this I extended it a little - to not choke on the expansions. As I don’t have the locale data that Apple is using, I made the tool work on my data - at the same time making it more posix compliant. There were many little issues while porting the code - and I wanted it to work perfectly before I submitted it - so it took me more than a week to complete the porting. I even made it compile with “-ansi -Wall -Wextra -pedantic”, thing I always do with my code.

Now, as the tool is completed and I did a final cleanup, I will test it on a bigger amount of data, and then proceed to port the libc part. I’m really excited to see how it works. When those two things are completed I will have to make a few more extensions to Apple’s code to make if fully compliant with UCA.

Planet FreeBSD Summer of Code 2008

Przemek Witaszczyk: WANTED: PIC driver...

Przemek Witaszczyk: Staying late pays...

Przemek Witaszczyk: /*decr_init()*/

Ryan French: Final Summer of Code Report

Przemek Witaszczyk: odd discovery

Vincenzo Iozzo: Final results

Anders Nore: Nearing end, call for testers

Przemek Witaszczyk

Przemek Witaszczyk: still no luck, and a new problem

Konrad Jankowski: Enter Libc

Ryan French: Weekly Report - 4/8/08

Anders Nore: New pkg_info -M (installtime comparison)

Przemek Witaszczyk: hard progress

Gleb Kurtsou: Layer2 filtering in pf

Gábor Kövesdán: BSD grep - Part 2

Rui Paulo: tcpad status report #3

Ryan French: Weekly Report - 24/7/08

Anders Nore: New features

Ryan French: Weekly Report - 17/7/08

Konrad Jankowski: Reinforcements from Apple

Przemek Witaszczyk: /decr_init()/