Monday November 15, 2004 
James C. Liu's Weblog
JDDAC at the Romberg Tiburon Center - SF Bay Estuary Monitoring
Well, how often does high-tech work in large scale enterprise computing fall right into a fisherman's habit? I had a nice conference call with a bunch of University and Corporate technologist folks yesterday afternoon about a project that needs a world class software architecture to provide real-time or near real-time data about SF Bay water quality and monitoring. The idea is to get data every 1 - 10 minutes from a wireless sensor grid that monitors all the estuary waters, and even middle and outside of the Bay and provide that data accurately and quickly to all users. Such a data would include real time lookups of conditions, as well as historical data monitoring for scientists, researchers and policy makers.
Sun and other companies started an initiative some time ago called Java Distributed Data Acquisition and Control (JDDAC). And immediately, one can see a strong business case for JDDAC. The challenge today in manufacturing, for example, is retooling costs for high-margin custom manufacturing. In other words, businesses can charge more money for some amount of work if they do custom work. But the costs of retooling are prohibitive and so customers tend not to order custom unless really necessary because it does cost so much more and manufacturers rarely provide discounts on any custom job unless one makes a very large order of things. The purpose of JDDAC was to standardize remote sensing and control technology so that businesses could retool and customize their manufacturing line to do more custom work at lower cost, thus meeting both customer demand and lowering business cost.
But then recently, some SF State U. researchers at the Romberg Tiburon Center that do Marine estuary research got wind of this initiative and quickly connected the dots. They've been funded by various gov't agencies to monitor Bay Quality. One of their major data consumers is NOAA. And some of their data is used in policy making for all sorts of things, from water diversion upstream, to quality standards evaluation of habitat for fish and wildlife. My details are only superficial and I'm learning more about this as I go along. But it sounds like a lot of fun.
I think I heard that they got a grant to design and build a new sensor grid architecture to monitor water quality. One of the design goals will be to standardize on software and hardware interfaces so a grid could be quickly and efficiently deployed anywhere (even exported to other sites around the world) to monitor many types of conditions - e.g. water clarity/turbidity, bio-fouling, mineral and other elemental concentrations for CO2, O2, pollutants, salinity, etc. etc. The system would need to scale as well. Starting with just a dozen sensor stations with sub-grids of sensors, the system needs to support thousands or more and do this in real-time. With such a plethora of sensors, having a standard interface and software to do data acquisition and control are vital if they were going to succeed.
Today, they have hardwired sensors mounted on some big concrete pilings along some shorelines. These are then connected phyiscally to computers and every 1 - 5 minutes, water quality data are gathered and store on disk to be processed later. It is non-real-time, and requires considerable human attention. The new system they want to build would be automated, wireless, and use standard sensor interfaces like JDDAC to collect data and control sensors. For example, one of the problems of taking, say turbidity measurements (murkiness of the water) is that algae and other crustaceans can foul the intake sensors. Their solution has been to put yet another remote control hardwired blower/pump around the sensor grid to clear the fouling prior to each measurement. More wires, more maintenance, more downtime. Ideally, by having a wireless and standard control interface, one control can proxy commands for another (much like USB or Firewire devices... you can chain them together). But there are obvious advantages to this technology for monitoring water quality, and when I brought up the concept of fish census, these professors all understood the challenge of figuring out how many fish are actually around in the water, data DFG/FGC need to assess stocks.
As an avid angler inside Bay waters concerned about Bay Water quality, I was delighted to see such initiatives for real data collection be funded and proceed at such a rapid pace. I was also delighted after a senior colleague of mine that leads the specification team invited me to become one of the participants for the software and network architecture. When the SFSU professors spoke about pier pilings and tidal currents and bio-fouling and piers, I could picture exactly what they were dealing with having spent some years now fishing these areas. And my colleague grinned because he knew that for this particular project, I was perhaps as eager to support this initiative as I was qualified from both the software and marine aspect.
And interestingly, word has come down from the Fish & Game pipeline that some folks down south in Monterey may be interested in a sensor station. Funding has occurred and I heard they are building a new Pier near the Moss Landing Jetty. This pier may only be primarily used for research vessel mooring and Monterey Bay science projects is what I heard, but that's early news and more details need to be researched. I need to contact some folks at CSU Monterey Bay to see if this is one of their projects and to ask if the might want to collaborate. I attended a great little symposium at CSUMB back in July or August and saw a lot of research posters from collaborative Universitys all over the West Coast and US. The symposium was sponsored by the NOAA (Nat'l Oceanic and Atmospheric Administration).
Who knew just fishing the Bay from pier and shore and along our estuary waters would have such beneficial and synergistic consequences? More to come... November 15, 2004 01:39 PM PST Permalink

California gets a little rain and what happens? Well one could say that the sky fell yesterday. Actually, a couple of tree branches came down yesterday outside our office and landed on top of some vehicles out in the parking lot. I'm sure glad none of the cars were mine and that no one got hurt, but it did put one driver into a predicament when he came out and needed to get to the airport to catch a flight. The driver of the rental vehicle (a silver Chevy Cavalier) had good spirits and with a little bit of help from colleagues, we cleared the trees off his car, which wasn't in too bad a shape. Hopefully, the rental company won't hassle him too much.
The driver of the blue minivan didn't suffer too much of a loss either, although she couldn't get into her car or back out since some thick limbs were caught between the two cars and stuck partially in her wheel well.
Apparently, a witness says that he was waiting for the Sun company shuttle Tuesday evening during the twilight hours. He heard a loud crack and looked up. A branch high above on an old, tall species of Eucalyptus tree I think (Tasmanian Blue Gum perhaps?) had cracked off and was barely hanging on by some small fibres and bark. He says he called the Security office to have them tend to this urgently since a crash of several hundred pounds of wood posed a serious threat. But he couldn't stick around to point this out to security because his shuttled arrived and had to leave.
No one apparently tended to the problem and in the morning, two unlucky employees arrived at our MPK24 building, parked as they would normally do and proceeded inside. Unbeknownst to them, the branches above their vehicles were precariously held by the slimest of margins and could come crashing down at any moment. Well, the branches didn't fall until shortly after lunch, when two large limbs ended up mostly on top of the silver Chevy compact. From the pattern, it looks like the branch on top broke first, and put its weight all on the branch below. The weight was too much for the lower limb to support and so it gave way and the two heavy limbs came crashing down. Luckily, the thinnest strips of bark must have held onto the falling limbs long enough so instead of a clean snap, the limbs pivoted downward, then fell more closely to the trunk where they hit the ground leaves-side first, bounced up a bit and rolled over the cars. Direct impact to the vehicles was avoided.
I had heard of Eucalyptus trees "shedding" limbs once in a while, but this was my first actual experience, . A quick inspection of the break points doesn't seem to show any signs of malformations from water, rot or insect damage. But a little of excitement on a quiet afternoon. November 10, 2004 06:15 PM PST Permalink
Most of us drivers in California already know about the smog test rules here. Basically, newer cars don't need a smog certificate, but after 4 years, all vehicles less than 30 years old are required to have a bi-annual smog certificate. Don't ask me why the policy makers in Sacramento put in the grandfather clause that allows 30+ year old cars to drive without passing the smog test, because it doesn't make sense. Some studies back in the late 80's and 90's indicated that 8% of all the vehicles (mostly the older ones without any type of smog equipment) produced 90+% of the smog).
How much smog a vehicle has the potential to make is measured as the percentage of allowable NOx, CO, and unburnt hydrocarbons (HCs). That's because these compounds react with moisture in the air and sunlight and create a hazy and obnoxious vapour that sometimes covers large urban areas. California still doesn't seem ready to limit the absolute maximum amounts of these pollutants; Our policy only enforces concentrations of these pollutants as percentage or parts per million in the exhaust stream. This means that an SUV with 10-cylinder, 6 liter montrous engine that's pissing a liter of gasoline per 5km could pontentially be releasing 10 times the pollutants of, say, a hybrid gasoline/electric vehicle with 1.2 liter engine that barely sips a liter of petrol and achieves 25km; they both get the same passing score on the smog test and both get people to work and school conveniently.
Last year, California did change its rule and instead of a low and high RPM smog test, they now require older vehicles to undergo a low speed (15 mph) and moderate speed (25 mph) on a dyno that can simulate the car going up a slight incline at these speeds. The test is tougher for older vehicles to pass because unlike the slow and fast idle test, this puts real load on the pistons and if rings and valves are worn, such a load will reveal a more accurate picture of the pollution released while actually driving. I'm not sure if all cars are required to take this test, but I've noticed the older ones and high mileage vehicles seem to be targets for this test.
I drive a 1992 model year Toyota P/U 2WD with 4-cylinder Fuel Injected 22-RE engine - perhaps the finest and most durable mass production engine ever made in the world, bar none [at least in the eye of this very satisfied owner]. This engine and its carburated predecessor, the 22-R, are legendary for lasting well over 300,000 miles without an overhaul. (Remember the "Oh what a feeling! (Jump) Toyota! Commercials?) The engine is mechanically simple and extremely serviceable and reliable. I bought the truck Dec 1991 while in College for just a hair over $7,400 out the door. It averaged about 24 mpg fuel economy while commuting to Berkeley and this included driving up and over the hills into Tilden Park in the mornings to avoid the gridlock along Hwy 24 and the Caldecott Tunnel. To my surprise, almost 13 years later, an audit of fuel costs and mileage today indicates that my flat-land-Silicon-Valley commute provides me an average of 28 mpg. Part of this no-doubt is due to the terrain difference. But another big factor has been the aerodynamics improvement of a lightweight composite flush-mount camper shell mounted over the truck bed. It streamlines the backside and provides a lockable storage area. Another factor are the improved tires at 33 psi that provide a few more percent mileage over the older tires at 28 psi. And instead of the old resistor spark plugs, the addition of platinum and iridium plugs and even dual prongs seem to improve the combustion.
My truck hasn't been in a shop ever for engine work. I've done all that work myself. It was recently in the shop for new tires and shock absorbers and some wheel bearings and seals. These were long deserved maintenance jobs that my home garage isn't equiped to do. But for a truck that has 174,000 miles on it, I'd say it has been well worth the maintenance. I now have a truck that drives better, I think, than it ever felt when I bought it, and it gets even better gas mileage than ever before.
So what about the smog test?
Two years ago, when I got the truck smogged, it passed with flying colours. But the test was the old slow and fast idle RPM test - not the new load test that went into effect recently. I had a few trepidations about that, so I decided to do some standard things to tune the truck up.
We all know that higher temps inside the engine produce more power. But this also produces more NOx. So it's like a balancing act. Too low of a temperature and you have too much unburnt fuel and no power. Too high a temperature and you produce NOx. That's why CA vehicles have EGR (Exhaust Gas Recirculation) valves. These take some of the exhaust and put it back into the engine to complete the burn but also lower the combustion temperature. A lot of things need to work properly to minimize HC, CO and NOx. One of those things is engine ambient temperature. So I flushed and refilled my radiator and replaced with new hoses and thermostat. The last time I actually had done that was at 78,000 miles so it was due at 174,000. I don't use the standard green ethylene glycol stuff that rots radiators, engine blocks, and water pumps after 30,000 miles. Instead, I use some special Pink stuff either from Toyota or some other OEMs. I think it's based on propylene glycol and lasts upto 100,000 miles. It costs about 3 times as much, but I think it's well worth the durability, protection and labour savings of having to flush the fluid more often.
I also did the standard air and oil filter changes, then changed the fan belts too. And then I focused on the ignition wires. Rather than get the standard OEM factory parts, I opted for some cheaper, after-market High-Current, low-resistance cables. I also put in some new Bosch platinum-2 dual-prong plugs. I yanked off the relatively new PCV value and sprayed some Gumout through it to clear it out. And lastly, I took off the intake throttle boot with the car facing down my driveway (so there was a decline) and sprayed copious amounts of gumout into the air inlet while keeping the throttle plate open. A lot of dark solvent flowed back out of the intake, which I intercepted with a lint-free rag. I later sprayed even more gumout inside and used a chopstick with the rag and pushed it into the intake to wipe down the flapper valve, and intake sidewalls. I try to be gentle and not poke around hard with any metal objects. There's some instrumenation in the throttle body to sense the throttle position and this is all hooked into the Electronic fuel injection, the Exhaust Gas Recirculation (EGR) and other emissions/ignition controls. As much as I'm religious about filling up with Chevron gasoline with Techron, I still can't avoid the gumming up of the intake manifold plus all the sensors, so I get paranoid before these smog checks to make sure that vacuum lines are in good shape, that the EGR value works under vacuum, and that the throttle body sensor openings aren't all gummed up and blocked. So I usually try to give the inside of the throttle body and the plate a good soaking and wipe down.
I did check one last thing which are the battery cables. An experience with Fords has taught me that engine electronics are sometimes quite mercurial when battery cables get corroded. So it can sometimes pay to spend the $8 to get a new cable and apply some contact grease to battery posts and clamps if you see a corroded battery cable. Mine were fine, except for some small cathodic deposits which I cleaned and coated with a conducting lubricant/protector to battery terminals. And then I hopped in the truck and drove down to my local Arco Service station.
To my surprise, they could not give me a standard smog test. My truck fit a "High Polluter Profile" and I was then sent to a "Test-Only" place where the folks are not allowed to make any repairs on the vehicle. I asked the Arco station guy why they do this and he doesn't know. He guessed that it was the gov't's way of keeping some of the Testing stations in business and also preventing some stations from cheating by doing certain minor tweaks to help some folks pass the test.
My results? Passed again with flying colours. I produced less than 1/3rd the average rate of unburnt HC, 1/20th (nearly immeasurable) CO, and only 1/8th the average NOx. In fact, the average is about 1/4 the maximum limits for my class of vehicle. Not bad for an old beater truck with 174,000 miles. And my truck's results were even better relative to average on the 25 mph test than the 15 mph one. It only took minor know-how and diligence in keeping the car tuned. But still, I can't be too pround of the crappy gas mileage of 28 mpg. I certainly have the right to gloat over those folks driving around in a big Chevy Suburban with a "Keep Tahoe Blue" sticker on their back window. But with the current VVT Corolla 2004 getting 40 MPG freeway, and the Prius hybrid getting 60 mpg in the City (yes! in the city!) my truck is a gas-guzzler by comparison. So, yeah, I'm feeling relieved that I passed smog, but the fact is, I'm pretty envious of those folks hauling around in those gas-miser hybrids. November 08, 2004 06:55 PM PST Permalink
Peninsula High Tech Waterfront Fishing
It was just a week ago that we switched from Daylight Saving Time to Standard Time. Suddenly, the modicum of evening daylight has completely disappeared. Certainly this happens every year as autumn turns toward winter. But I can't help but think how much better work life seemed just a few months ago when twilight lingered past 9pm. During those months, I would drive to work with fishing rods in the back of my pickup truck. I made special efforts to get out and meet with local ISVs during the afternoon. And for good reason, many of them are located on prime Bay Area waterfronts that provide some great shoreline fishing inside San Francisco Bay.
A host of High Tech companies are located on prime fish-producing waterfronts. Starting just north of SFO Int'l Airport, is the Sierra Point Technology Park. Home to Hitachi, Collab.Net, Turbo Linux and others, it provides some 1/2 mile of shoreline and a public pier to fish from. Just a few minutes south is Oyster Point, where there is another public pier and considerable length of shoreline from which to fish. Heading further south to Hwy 92, there are a number of companies like Siebel, Blue Martini and RSA. SAP used to also be along the 92/101 corridor. These ISVs are just 10 minutes from some fishable shoreline adjacent the San Mateo bridge. And just under the current San Mateo bridge is a nearly mile long remnant of the old San Mateo bridge built originally in 1929. It's called Werder Pier and until 1995, when it was closed to provide CalTrans access with heavy equipment to fix the underside of the new San Mateo Bridge, Werder Pier was California's longest fishing pier, extending almost to the edge of south bay shipping channel where the deep waters are a magnet for large sturgeon.
Further south on 101, we soon hit the 2nd largest ISV in the world - Oracle Corp. Their company headquarters are just off the Ralston/Old Marine World Pkwy exit. If one drives east on the Old MW Pkwy about 1.5 miles to Shearwater Pkwy, one will hit a jogging path adjacent Belmont Slough, which connects to the Bay. Here, the slough is shallow and muddy during low tide, but can get filled nearly to the brim when the water rises almost 8 feet at the crest of a high tide. The slough meanders through sets of high tech buildings and winds its way west behind Oracle HQ. The slough has connection pipes and large gate valves that manually regulate flows in and out of the many Peninsula lagoons in the Redwood Shores area. Many anglers are known to have caught Gobis for bait fish in the lagoon directly across the street from Oracle Corporation, opposite of Larry's Pond, as many folks have named the small pool and lighted fountain outside bldg 600 that sometimes provides a pretty display to passers by.
Anglers wise to the tides in these sloughs can find brief periods of 30 minutes 4 times each day when many types of fish cruise in and out to feed. Below is a picture of my son, with his first Striped Bass. About 5 lbs and 24 inches long. Caught just a mile east of Oracle Corporation on Oct. 31, 2004.
Just one more exit south is Holly. Heading east, Holly becomes Redwood Shores Pkwy. And nestled in between the numerous waterfront homes with well-landscaped meandering sloughs that wind between homes, we can find Steinberger slough. This thin slough nearly goes dry during low tide. But with the incoming tide, the water quickly rushes by heading west all the way past the San Carlos Airport and near the Hiller Air Museum and under Hwy 101 into San Mateo. This slough and many of the other small sloughs that flow between homes along the Radio Road strip can hold some surprises like California Halibut, Jacksmelt, skates and bat rays, and small smoothound and leopard sharks.
Still heading further south 2 exits to Seaport Blvd, we can head east and go to the Port of Redwood City. All the way east to the end of the port is a new technology development called Pacific Shores Center. A mile long public shoreline, modern and well maintained landscape and parking facility, baseball fields, soccer fields and basketball court are nice amenities. But there are quite a few large mirrored high-tech buildings. You'll find Openwave and Informatica located here. Employees can enjoy a lunch outdoors and cast out from the steps near the north end of the shoreline and catch some giant Myliobatis Californica (California Batray) which frequent that stretch of water. My personal best exceeds 80 lbs from those steps.
Two more exits south again and you will hit Sun Microsystems, Menlo Park Campus. Fishing access is not particularly good out behind MPK22 (the Company Rec/Gym) along the path. Salinity conditions are too high and varied right there due to evaporation ponds run by the Cargill Salt company. But in winter, after heavy rains, the channel out at the very end of the jogging path may provide a shot for a sturgeon or two. In the old days, the west end of the Dumbarton bridge was referred to as Ravenswood point. And a number of feeder creeks like the San Franciquito Creek empty out into the Bay not too far from the Sun MPK campus. Not more than 5 minutes south in East Palo Alto is one spot to catch more rays and sturgeon. The only issue is the dangerous neighbourhood. And for folks living in the East Bay, the Sun MPK campus is great launch pad for heading across the Dumbarton bridge toward the Newark Campus that is just adjacent to the Don Edwards Wildlife Refuge. This is a federally managed wildlife refuge that has an amazing diversity of birds and other wildlife. And best of all, the Dumbarton Fishing Pier is inside the park and provides casting distance access to the eastern side of the SF Bay shipping channel. The Dumbarton Pier sees more sturgeon caught regularly than just about any other salt water pier in California.
As we head further south, we'll find more familiar names. It seems like any town along 101 with an ISV can find some fishing just 15 minutes away, be that Palo Alto, Mountain View, or even Sunnyvale.
Much of the fishing is easily accessible for drivers and most are family friendly. The fish may not be good to eat or even healthy, but at least they are exciting to catch and release. It's also a great way to relax after a meeting with an ISV. During the summer, I was certainly motivated to work with my partners. November 06, 2004 01:47 AM PST Permalink
Big Barbeque HowTo for Techies
Too busy to blog!
I stopped blogging for quite a few weeks now. Just too busy to even get my head out of work mostly. I was one of the lead organizers for an annual internal technical training and conference and headed up IT, registration, audio/visual and food for the week-long event. Our group of about 200 people worldwide has undergone some major changes in the last few months. A complete re-organization. All new VP, Sr. Director, and Director that I report to now. I'm in a new position too, doing similar techie stuff, but under a slightly different charter and for slightly different vertical market segments. Morale was pretty mixed at the beginning. But people seem to have cheered up after the conference where they all had a chance to enjoy a few cold drinks and some good food. I must say that the week long event couldn't have been a more perfect venue. We had speakers like Andy Bechtolscheim, Scott, and Jonathan do keynotes for us. And they didn't disappoint. I felt it a personal duty to serve food that was at least worthy of such a great program.
Hosting a week long event can be tough. We had great help from our organizing committee. Content was led by Matthias, a German colleague out of Sun's Walldorf office. And logistics for budget and travel were handled by logistics expert, Don. He pretty much shaved travel, lodging, and ground transportation costs down to around than $1000 per person for the roughly half the participants coming from 13 other countries and 5 major areas around the US. As we all know, budgets can be tight, and directors are given very limited dollars for group team events these days. Times were more encouraging this quarter because those funds were more available. But still, the overarching directive was still to watch our costs. Still, I actually had the opportunity to lead 2 major events - a BBQ and a Luncheon and act as primary cook for a third (Fajitas & 'Ritas). The Fajitas and Margaritas party and the luncheon were employee funded with minor support from the company, while the BBQ in the park was picked up completely by the company. The costs? Well, the Wednesday BBQ for 160 people cost just under $5/person. The Thursday Fajitas and 'Ritas (Margaritas) Party for 69 people cost about $5 - $10 each depending on whether a participant imbibed, and the Friday luncheon for 180 was just $3/person.
Catering to my Colleagues
First of all, I love to cook for people and I love to grill. It goes back to my academic history. I was pretty active in student societies back at Cal Berkeley. In my senior and 1st grad school years, I was BBQ'ing almost 3 times a week for various student groups. These were mostly morale/team building events that were revenue neutral. But the joke in the College of Engineering was that I was the master of porous media Heat Transfer - the porous media being charcoal briquettes, real wood, or fake crushed volcanic stuff over a propane fueled flame. There was just something about grilling outdoors that put me in touch with my primal roots. Beat the tom-tom drum. Sing Kumbaya kinda stuff. Bond with nature, yadi yadi yadi.
Wednesday Afternoon BBQ
Getting back to the Wednesday BBQ. There are lots of ways to cater a large outdoor BBQ party, but quality and quantity can vary drastically depending on the help, menu and venue. And I can't overlook good help. Some of our group admins have tremendous logistical experience with events and they showed up and helped out. Our of our stars, Kim, is 8 months pregnant (almost 9 now) and she showed up early with 80lbs of ice! We also had 3 engineers show up early and post signs along the roads and park to guide folks to our destination, plus setup the chow lines and place all the food for optimum parallel processing of hungry eaters as they came through. The Directors showed up and ran all the slice-n-dice food prep operations for hors d'oeuvres and other items. It was real team work.
But for the best help, my recommendation would be tough for anyone else to follow, because I would suggest that you marry a spouse as helpful as my wife. She really pitched in with the shopping and the food prep. We were both up late the night before, first shopping and then prepping and marinating, and then up again at 4:30 am in the morning before the BBQ to prep some more, cook some of the dishes and load up the vehicles, etc.
BBQ Risk Management
The way I organize a BBQ is all about risk management. There's environmental risk, like the weather not cooperating. And there is operational risk. Certain operations can be delegated, like setup and cleanup. But some operations, like procurement, must be controlled by and given to a single party or we risk having the standard asyncronous potluck syndrome - too much beer, chips, cake and spoons, but no plates, forks, diet beverages and main dishes. Then there's the health risk. One challenge here is sanitation. Another challenge is storage. How many folks can handle literally 1000 lbs of liquid and then deliver it the day of the event? What about a hundred pounds of raw meat? How many folks have food-service experience? While the risk of e.coli and salmonella contamination are fairly low, with a company event, 200 high-IQ engineers could be made pretty unproductive for quite some time if some outbreak should occur. Having worked in a restaurant for 4.5 years and done lots of procurement, usually, that's a job I take personal responsibility for. This leaves Menu and Venue left as action items for others to decide.
A Possible Menu
Planning an event is almost like doing Product Life Cycle (PLC) Management, only the time frame is a lot shorter. You have an approval committee that has managers and architects, and multiple people are tasked with action items (in our case - a BBQ Event) and we draft half-pagers and one-pagers outlining our proposed Architecture or Menu. Cost/Benefit ratios are analyzed, small separate committees and product teams (cTeams and pTeams) form around separate tasks and we set milestones. As milestones come and go, we track progress, and finally, come GA, people pull all nighters to make sure stuff ships on time. In our case, it all started with my proposed menu. Since I took responsibility for procurement, the group thought it only appropriate to give me the privilege of doing the menu (not to mention it would save a lot of hassles all around to just have me do it.)
For openers, I was planning on smoke salmon on french baguette slices with olive oil, pickled capers and dill weed. A classic hors d'oeuvre, but somewhat labour intensive. Others suggested that we simplify and modify this and provide individual bags of variety Chips - a la Frito Lay-style. We thought about this and it was decided that we do both. The Directors we given the assignment to fabricate the smoked salmon hors d'oeuvres and they did an okay job, although they skimped on the smoked salmon and only used up one pack of salmon and left about 2 baguettes. The next step was to provide some first course (Prima Piatti) options. Usually, in the states, this means salad. We decided to offer a tossed mixed salad (insalate miste) but with a Ranch dressing and small tiny olive tomatoes plus optional Potato salad. Both are extremely affordable and come mostly pre-packaged off-the-shelf. Next was to provide a Carbohydrate option prior to or with the main (second) course. We considered the sensitivity to all the Vegetarians and came up with two optional items. Garlic Bread Forte (strong garlic bread - Bamm!! with like lots o' Garlic), sweet dinner rolls (for folks with the Vampire retro virus - intolerant of garlic), steamed Basmati rice seasoned with Tumeric, Saffron, Cardamom and Raisins, and lastly, spaghetti with a simple marinara sauce. The main course would be an assortment of grilled boneless beef rib steak and boneless dry rub seared chicken thigh meet, italian sausage and Cajun style Hot Links and Portabella Mushroom Burgers. For desert, we planned for any bulk bags of seasonal fruit like apples and oranges. And finally, for drinks, we went with a full non-alcoholic beverage list of all individually bottled or canned sodas, diet sodas, sparkling water and plain bottled water sans gas.
Note on Vegetarians/Vegans
Vegetarians are categorized as folks who do not eat meat, but may eat eggs, cheese and other diary products. Vegans do not eat any animal products whatsoever. In any high tech company doing software these days, you can expect about 30% of the people to eat vegetarian-only and a small 1% or so to be Vegan. These are mostly the Indian engineers, and we need consider their needs as well. This means purchasing 100% durum wheat pasta (no eggs) or making a number of traditional rice and lentils dishes that do not contain butter, milk or eggs. And in some cases where stock is required in a sauce reduction, we need to use vegetable stock only. Since such dishes can be appealing to both meat eaters and vegetarians, it's important to make enough for everyone. That gets a bit tricky sometimes because some dishes may be labour intensive or costly and thus limited. For example, 2 years ago, at previous BBQ, I had a stack of portabello mushroom burger/steaks simmering in a marsala wine gravy that was enough for 30 or so vegetarians. But the mainstream folks loved them so much, it got depleted in less than 3 minutes and so quite a few vegetarians went without their main course. It still bothers me that I didn't prepare for that outcome and some folks went hungry. The obvious response by the omnivores was a bit callous - "It's BBQ Darwinism - Omnivores rule!"
Venue
This year, we chose to host this event at Sunnyvale Baylands Park - a municipal park that was both nearby and reservable for a fee. Another good thing was that this park had defined hours when they opened and closed, and charged all persons for parking. Such parks are usually fairly reasonable venues, costing just $300-$500 for site reservations, and discounted parking for groups on the order of $3/vehicle. By carpooling, the parking fees can be further reduced. We could have found a cheaper venue for sure that was only $50 to reserve and had free parking. But we chose the paid route this year for several reasons. The first is that the fees help to maintain the park in optimal condition. Free public parks tend to be more run down and lack clean facilities like bathrooms, electrical power and potable water. Second is that the defined hours and cost inhibit transients - especially the mentally unstable - from taking up residence in the park. Last year, when we hosted a previous BBQ in Milpitas, I ended up having to call Police when a young man in his early 20's on a BMX bicycle decided to crash the party. He began reaching down into his pants in front of a group of us, including our V.P. We've learned since then to be more selective about venues.
Heat Transfer
Make no mistake that in a BBQ, the key to cooking is mastering the Fire. The type of flame one targets really depends on the type and size of the BBQ. Typically, public parks have two types of BBQs. For single family and small picnics, they have a small metal box welded on top of a pedestal. It has a 1/2 sq. meter grilling surface and slots on the sides that allow the grill height to be adjusted. For larger group BBQs, many parks have masonry pits. These are often about 2 sq. meter area rectagular pits recessed inside a waste high masonry structure. A heavy wire mesh screen on a chain and pulley allow the entire grill to be raised or lowered over the pit via a long crank handle or cog wheel.
I know some folks who bypass public BBQ pits and lug their own grills because the public units are either broken or filthy. While this is sometimes necessary, often, a stiff wire grill brush plus a very hot fire are enough to rejuvenate even the most gnarly of public grills. Fortunately for us, the Pits at Sunnyvale Baylands are in premium condition. They are the big rectangular recessed pit types and each have potable water on one side of the grill and an electrical outlet with 110 VAC power on the other. Each reservable area sports 5 such pits and its own prep table, picnic tables, and garbage and recycling receptacles. Truly one of the finest public parks facilities I've had the privilege to cook at.
For public pit BBQs, I use a 3 stage fire that takes about 35 - 45 minutes to get ready. It starts with a modest amount of charcoal briquettes on the bottom. Any brand will do. I only use this as catalyst to pre-heat the pit. About 5 lbs shaped into a conical mound works for small pits. About 20 lbs (10kg) are more appropriate for the large pits. Note that the mound should be shifted over to one side of the grill. Which side? Well, take a sense of the wind direction and observe over a few minutes. Then position yourself on the side of the pit where statistically the wind is mostly at your back. This is critical when you cook so fumes from the smoke don't overwhelm you. For right handers, the main fire should be primarily on your right. Raw food starts on this side, and as it cooks, you flip it and move it to the left. Lefties should start fires on the left side. Don't worry if you don't cover the entire pit. You only need about 1 sq. meter of cooking surface per 75 people or so. You want some areas without direct heat underneath for food warming purposes but not cooking.
Next, squeeze a generous amount of charcoal lighter on the mound of briquettes. About 25cc/kg (about 0.4 fl. oz per pound of briquettes). Let it soak into the coals. Then light the fire. Wait about ten minutes and when the primary fuel has burned off, toss about twice equivalent weight of mesquite chips on top of the charcoal. If you like, you could switch and mix 50% mequite, and 50% hickory chips. You can buy BBQ chips from most BBQ supply places. Walmart has this near the garden section in 18lb bags. The key is to get blocks of chips that are about 5 cm in largest dimension but no smaller than 2.5 cm in smallest dimension. Technically these would be more like blocks than chips. Tossing the chips on the coals can snuff the flames out or reduce the flames initially. Don't worry, if the charcoal has been ignited properly as per the instructions above, it will reignite the chips in due time. If you're in a hurry and need to accelerate the process, get a piece of cardboard or a large, stiff paper plate and fan the coals for a few minutes to get oxygen into the center. This makes the coals red hot and when you stop, you should see a light blue flame shoot up as the adiabatic flame temperature really hits the 500 deg C mark the chips ignite readily.
Note that on rainy days where the humidity is in the high 90 - 100%, BBQs are very hard to light and start. Increase the fuel amount, and protect the coals and wood from getting damp. This is critical or else you make need to take much longer to fire up the coals. If rain is coming down, well, hopefully, you had a contigency plan to cater the food indoors and bake or broil the items in an oven. (But it doesn't rain often in October in California. We had 26 deg C weather most of that day. Just fantastic.)
Once the wood chips are burning well, which should be about 10 minutes later, take a fireplace poker or long sacrificial stick and spreadout the coals and chips more evenly. I then place oak or almond hardwood logs on top of the coals and let these catch fire. Again, about 2 or 3 times the amount of original charcoal by volume. I let this burn about 10 minutes more, until more than half the surface of the logs are white charred and glowing. It's now time to lower the grill above the fire. You should feel a tremendous amount of heat rising up as you get close, since the walls of the pit effectively insulate all heat loss from the side, all the heat is directed up. The heat may be unbearable. Usually, if I reach over quickly, just above the pit, the tips of the hairs on the back of my hands and forearms will burn. I highly recommend at this time to you have a small 2 - 5 gallon buck next to you, filled with cold fresh water for keeping your hands and arms moist. The evaporation of water will protect the skin up to 15 seconds as you reach over to manipulate food. But once your skin goes dry, you can receive 2nd degree burns easily roasting your hand and arm over the fire.
Note: For our event with 160 guests on the RSVP list, we expect about 15% more party crashers (because of the free food and proximity to our Santa Clara Campus). To accomodate such a large crowd, we decided on two pits to double the cooking surface. This also made sense since would could now toast a lot of vegetarian items on one grill with one set of utensils without fear of cross-contamination with meat and/or meat juices from the other grill.
Cooling down the drinks
Initially, such a fierce fire is not really suitable for cooking. Food would char instantly and the inside would still be raw. However, this heat is great for sterilizing and carbonizing any deposits on the grill. I usually let the heat do its job at this time and come back later with wet hands and a stiff wire brush to clean it before putting on my first items. Around this time, I prepare drinks, a thankful task because it gets me away from the pit and doing something that involves cold ice.
Lots of people think that with BBQs, the biggest task is the preparation and cooking of meat items. In fact, that's probably not true. If you deal with 18 - 29 year olds, the average male will eat only about 3/4 pound of meat (wt. before cooking) at any BBQ. Females eat just under 1/3 rd pound of meat. For the group 30 - 45 years of age with , reduce both down by 33%. That means for a group with average age of 32 years and 3/4ths males, and 1/4th females, we can expect 200 people to eat less 100 lbs of meat type items.
However, if the weather is warm, which it was 3 weeks ago - you can expect each male to consume close to 2.0 liters of liquid during a 5 hour period. Not all of it is actually swallowed, but people tend to waste about 25% of their beverages because they don't finish it before getting a new one, or they confuse it with someone else's beverage and then don't want to drink it. So on a hot day, we need to haul a lot of drinks. And the amount could even be more if most folks decide to participate in any physical activities like soccer (football), frisbee golf, etc. For 200 persons, this means having about 5 lbs of liquid each or about 1000 lbs of drinks. Try hauling that in a normal vehicle or minivan. It's quite difficult. And for most employees, such a monumental undertaking of hauling 1000 lbs of liquid is just not practical. That's where my wife and I come in. I drive a small Toyota Pickup. She drives a Sienna minivan. Between the two of us, we can haul about 1 tonne. This is sufficient for most warm weather BBQs upto 200 persons.
I still haven't gotten down to describing how to cool down the drinks. And this is a logistical trick. Basically, in warm weather, ice melts quickly. And it takes up volume so it's difficult to store. The key therefore, is to buy the Ice the morning you plan to use it. Or better yet, if someone on the team has an Uncle that owns the largest west coast Ice distribution company, even better. In fact, Kim, our expectant admin has an Uncle who has an Ice company, and we were able to get high quality (i.e. very cold and small chipped) ice in large quantities, and we could get it shipped to our site at exactly 11am prior to 12:30pm serving time. We needed a total of about 100 lbs of ice for the afternoon to chill about 1000 lbs of drinks.
With 3 bushel-sized large plastic drink tubs and two large capacity ice chests, we were able to load about 1/2 of all the drinks loosely into the tubs and put about 2/3rds of the ice into the ice chest. We then took ice bags and spread the ice over the drinks. The solid-to-solid contact of ice to beverages has very low rate of thermal diffusion and low Nusselt number. Such a tactic would take 2 hours to chill down drinks. To reduce time down to 15 minutes, a trick we heat transfer guys use is the 0.4 deg C triple point for water/ice/vapour mixtures. Basically, you can be assured that if you have a water/ice slurry, the temperature of the water will remain pretty close to 0.4 deg C as long as solid ice is still present. A beverage in contact over its entire surface with such a cool slurry will cool down to just 5 deg C (frige temp) in just 15 minutes or less. So the key is to add water to the tubs to immerse most of the drinks and then pile on the ice and somewhat fold it into the water to make a slurry. The Nusselt number goes way up as the liquid water not only increase surface area, but provides a fluid for much more rapid convective heat transfer over the ice alone.
Where's the Beef?
Good meat is hard to come by these days, at least at a price that can feed a hundred or more people for cheap. Thank goodness for Costco. The perfect store for these occasions. It sells a boneless beef chuck rib meat that comes in strips about a foot long and 2 inches in diameter. It's usually got a square cross section which is nice for grilling because it won't roll around, letting you keep track of cooking time per side. The meat is nicely marbled but somewhat tough along the grain with a few sinews. For just $3/lb, it's a bargin. It's great for stew meat and much more tender after a long cooking period. Plus it has great flavour being next to the rib. It is far more moist than a tri-tip or skirt steak at $4/lb, both of which get tough and dry. However, there's a reason why the meat is cheaper. It isn't shaped in anything close to that of a steak being long rather than flat and round. And it can be a bit tough just out of the package without treatment. Also, as far as steaks go, it isn't designed to be served as individual slabs. Instead, it needs to be cut across the grain into slices about 3/4 inch thick and served as small steakettes.
But, there is no doubt this meat can rival the flavour and satisfaction of a ribeye. The key is preparation. Most strips have one side that has a thick, attached membrane that was stuck to the ribs. This needs to be trimmed off and any excess fat removed. This comprises no more than 5% of the weight usually. Then the meat needs time to marinate and break down. There are two schools of marination - one that works and one that doesn't. One school recommends using enzymes to break down muscle fibres and protein, usually with some tropical fruit juice. But as steak aficionados already know, this destroys texture and makes the meat gritty.
The other way is to use some type of chemisty, usually with mild pH differences, and sharp changes in salinity or chemical concentration to drive cellular breakdown or dissication which is more akin to aging. This is exactly the same as brining meats, which makes them retain more moisture during the cooking process, but while in the brine, the tissues soften quickly. Depending on the kind of marinate and the degree of saltiness, temperature and other factors, you may only need to marinate for a few hours. But I like to go easier on the salt and marinate over night and kick in some other flavours. My wife discovered a brand of Korean BBQ sauce that isn't the standard tangy/spicy one used on Kalbee. Instead, this is similar to a Japanese style of steak marinade. Very low viscosity, but very dark. It seems to have some molasses and dark sugars, rice wine, salt, dark soy, and other ingredients. It isn't as salty or sweet or viscous as other sauces. This works very well on chicken and beef, and it especially works well with these rib steaks. A large zip-loc freezer bag with about 5 lbs of meat and about 1 cup of this sauce mixed with 1/2 cup of water seems to do the trick. Since the meat comes mostly defrosted but somewhat still solid in the core, a space saving trick is to use an ice chest and store the meat there overnight. The meat can melt and still stay as cool as the frige, and marinate more quickly.
Coq au Vin
Chicken and white wine just seem to get along extremely well when combined and cooked, releasing aromatic esters. My wife does an oil-n-spice mixture of light olive oil, Montreal Chicken Seasoning and some italian herbs and slathers this over boneless chicken thighs. Generous portions of chicken get shoved into zip-loc bags as well and before throwing them into the cooler, we pour a 1/4 cup of a good white wine, like a $2/bottle Charles Shaw Chardonnay you can get at Trader Joes. It takes less than an hour to process about 60 lbs of chicken this way, and the results are about a dozen bags of ready-to-grill poultry that takes about 15 minutes per batch.
Meanwhile... the BBQ Pits have settled down
After a good 45 minutes, the BBQ Pits settle down - no more big flames and smoke. It's very white and red and very hot. About 20 minutes before the bulk of the people arrive is when I usually take a final pass at cleaning the grill, and then start placing meat over the fire. The fire is not always uniform and there are always hotspots. In addition, the first 30 minutes or so, the flame may be so hot that you really need to watch the meat closely and flip it a lot. In fact, keeping the grill an extra 6 inches higher can allow you to keep up with the flipping. The chicken may have lots of oil residue and it can drip into the fire and cause flare ups. And the fatty parts of the beef can drip as well.
Keeping hands and arms wet and moist is critical early on. Also, having a long metal skewer, like a fireplace poker with a sharp hook on it is better for reaching across to the middle of the grill without sticking your arm over the pit and getting it roasted. Remember to use two sets of tongs and flippers. One for raw, and one for cooked. I make it almost a religious practice to only handle food with the raw food tongs until such time that the exterior is cooked. And then all the handling is using another set. This is the reason for having the fire on one side of the pit. The raw food is placed on my right side, then moves left as I flip it. As I take it off the rack on the left, I switch and use the cooked tongs. For most right handed folks, flipping by rotating the wrist counter-clockwise is easier and hence you want to start out on the right side and flip moving left. Chicken is done in about 15 minutes if it has been kept flat. If the meat is balled up, you will need to check the inside. Sometimes, it can take 25 minutes or more. So it's important to lay the pieces down flat originally on the grill. The steaks take about 20 minutes to cook because they are thicker. Individual chicken pieces can each represent their own serving. But the foot long strips of rib meat are better off being cut across the grain into 3/4 - 1 inch thick slices. This steak is still tender and juicy even medium well, so it is not necessary to have different batches to accomodate those that like their steaks rare or medium rare. Also, for such large parties, it's usually best to error on the side of well-done.
I don't recommend slicing the meat immediately. I prefer to have an aluminum tray or two trays (one for chicken, one for beef) at the colder end of the BBQ to put cooked items into. it's still warm for sure. But just not so hot as to continue cooking. Here, meats can stay warm, but rest for a few minutes. But sometimes, you have no choice if a queue forms waiting for fresh meat off the grill. However, if you did have time, ideally you'd let the strip steaks rest for about 5 minutes and then slice them. This pause gives the meat time to reabsorb some of the juices that were boiling inside and trying to move up through the meat driven by the intense heat.
The hot fire early on is great for cooking fast, and hopefully it satisfies the bulk of customers coming to feed. As the heat reduces, you can lower the grill closer to maintain the cooking capacity, or leave the grill at the same level and reduce your urgency by which you watch the food. Then maybe you can change shifts with an alternate grill-master and schmooze with others.
Sausages, Portabello Patties, Garlic Bread, etc.
Cooking sausages is the same as cooking other meats. The key is to use tongs and not a poker. We don't want to puncture the skin on a sausage and thus allow the juices to escape. Sausages are best left till after the fire is a bit cooler. This is because they tend to have high fat content and can catch fire easily when the grill is extremely hot. It's better to slow roast them. Sausages are ready when the skins get translucent and split or holes start to form and allow juices to escape under pressure. This means the center has reached a pressure above 1 atmosphere, and thus inside the sausage, with the salinity factors, the temperature must exceed the boiling point of water. It's a good practice to leave a sausage that is squirting on the grill for another minute to ensure that the interior is evenly cooked. Afterwards, I also like to slice sausages into bite sized chunks. Those who like it can take more. Those who don't, won't waste as much.
For vegetarian burgers, garlic bread, and other non-meat items, the grill will cause a major reduction in moisture. Garlic bread, because it will toast so quickly over the hot coals, this isn't a real problem. But with any type of vegetarian patty, they can turn into cardboard - literally - they will taste and chew like cardboard. What can work is to pre-fill an aluminum tray with a rich, vegetarian broth and red wine reduction with some type of tomato-base sauce. Off-the-shelf BBQ sauces that are thick and viscous can work here. Taking one part sauce, and one part stock and adding a teaspoon of red wine per liter of total liquid can make a very nice mixture. All this can be placed and mixed inside the aluminum tray, then placed directly on a hot part of the grill. The sauce will simmer after about 10 minutes and begin to reduce. As you finish grilling the Portabello patties, you can then dump them into this sauce and preserve the moisture and add a lot of flavour and also keep them hot. Folks who serve themselves will then have a very nice, moist and rich sauce taste on a vegetarian product. The only problem though is that the non-vegetarians may like this too, and deplete your resources quickly. I came prepared with 2 x 28 packs of vegetarian patties.
Aftermath
Clean up is always a problem. If everyone simply picked up garbage and/or recyclables around them and put stuff in its place, the rest of the things would take care of themselves. But lots of times, folks abandon their messes and others need to pick up after them. I usually travel with all my service ware, supplies, cutting boards, knives, kitchen supplies in large plastic tubs with lids. Dirty stuff all goes into a special tub and gets taken care of at home, and I keep a separate one for small leftover stacks of plates, cups, and other paper products to be used for the next event. Packing and gathering leftover stuff takes less than 15 minutes usually. But I try to allocate 30 minutes for final walk through to clean up the place, and another 30 minutes for sorting garbage from recyclables. It's amazing how many folks will be careless about throwing away a recyclable into a trash recepticle when the recycling bins are just 2 feet away. But allocating time for clean up ensures that next time, the park maintenance folks will welcome you back. Oh, having rolls of paper towels, a pack of food service plastic gloves and a jug of disenfecting wet wipes are pretty much de rigeur for us BBQ warriors!
Total bill for the event came to about $861. The total number of participants could have been about 175 or so. It's hard to say. It sure was a LOT easier hauling stuff back. I was left was just a few bags of chilled meats and supplies, and less than a dozen bottles of water. At $5/person, that's good morale boosting, I think. November 05, 2004 06:57 PM PST Permalink


