My Illumos troubles keep coming

I am currently trying to add the snappy compression into ZFS for fun. You can check out my code here: https://bitbucket.org/techsaint/zfssnappy
I've been working on this for a few months (started around august). I've had massive roadblocks every step of the way.

The first was the oracle purchase of Sun. Because of the purchase, the Sun Compiler tool patches (which were needed for an illumos build) were removed from the public. It took a month or so for the community to post instructions on using GCC instead of the Sun Compiler.

After that, there was slight bug in the illumos build configuration that didnt allow for working builds if your new build version was older than the whatever version of illumos you were on. See https://www.illumos.org/issues/1118

Now this new bug, is a virtualbox bug, which just appeared out of no where. Here is the ticket: https://www.virtualbox.org/ticket/9651. Since I rebased with the latest illumos code (as per build instructions) I must've picked up the bug, maybe a regression?


Will i ever actually finish this project? I am not sure. I hope someone else with much more experience with opensolaris/illumos looks into it. I think snappy compression is a great fit with ZFS. And it being a BSD license means it is unencumbered. Until then, I may put this back on hold, or maybe grab an older version of the illumos source just to get a proof of concept. Maybe use another VM for now. I'd like to run some preliminary benches to see if continued work is even worth it.

Comments

Post a Comment

Popular posts from this blog

So I've again been bitten by the Transcoding/transpiling bug...Doh! My history with Transcoding  A few years back (around mid-2007), I was enamored with a new language on the block, JavaFX (now vala). Alas, I had moved on from the Java platform to the .Net platform during that time, and Silverlight just hit the stage (and WPF). I was more of a fan of the declarative and expressive nature of JavaFX than I was of XAML, so I looked into porting JavaFX script to the .Net platform (and later the DLR). I halted my work in 2008-2009, as JavaFX script was dying, and the Parser technology I was using (a great C# based parser called Irony) was giving me issues when integrating with the DLR. The LLVM Project I've been a fan of the LLVM project since about 2009. I have also watched its MSIL backend go into disrepair and interest in C# as part of the vmkit wane. I answered some stack overflow questions in 2011 about this http://stackoverflow.com/questions/5054938/how-to-translate-
Read more

AutoConf and M4 bliss

Just wanted to make a statement that the CLI tooling for building software in linux (and really any *nix) has changed dramatically. In my mind, configure and make were all black boxes and it was very very hard to actually effect them as an independent developer once they were baked. This is not the case anymore. I was able, with autoconf, automake, and m4 templates (and of course some C++ glue) to actually integrate two libraries (zfs and snappy-c) that know nothing about each other. This is a testament not just to the auto tooling, but the level of maturity of a lot of open source software out there. While make is still technically a black box (yes, make scripts are simple in concept, fine...but go look at Illumos makefiles and we'll talk...), it may be ok for make to stay in the shadows...like some x86 assembly that gets generated on the fly... I just might, after this zfsonlinux + snappy release, revisit illumos. But from what I recall of the original opensolaris documentati
Read more