Tuesday December 25, 2007
Merry Christmas but sorry, no webkinz
Important statement about the content of this post:
I've been informed that Ganz is in fact taking every step possible to ensure they provide their community with an infrastructure that will support the heaviest loads. Sun is in fact working with Ganz to provision this infrastructure, but due to a number of complex reasons the teams were not able to complete the migration prior to the Christmas rush.
This post is strictly my personal views and does not represent that of my employer or coworkers. I had underestimated the complexity of managing such a large site. Some conclusions in this post are premature based on incorrect facts. My sincere apologies for any hard feelings and hindrance it has caused to webkinz/panther team during this holiday season. Thank you very much for bringing us this fascinating gift and see you soon at webkinz world.
Sincerely,
Cheng Fang
So today is the Christmas day, a moment kids have been waiting all year long. After getting a Chihuahua webkinz from Santa this morning, my daughter wasted no time trying to log onto webkinz to play. But like millions of kids around the world, she was greeted with this gloomy message on webkinz homepage:

Out of curiosity, I wanted to know what kind of server webkinz is on. This is what netcraft has to say about this site:
| Netblock Owner | IP address | OS | Web Server | Last changed |
|---|---|---|---|---|
| Panther Express | 195.12.231.201 | Linux | PWS/1.1.29 | 20-Dec-2007 |
| Pather Express | 213.244.185.11 | Linux | PWS/1.1.34 | 18-Dec-2007 |
| Panther Express | 195.12.231.220 | unknown | PWS/1.1.29 | 16-Dec-2007 |
| Panther Express | 195.12.231.210 | Linux | PWS/1.1.29 | 24-Nov-2007 |
| Panther Express | 195.12.231.220 | unknown | PWS/1.1.29 | 22-Nov-2007 |
| Panther Express | 195.12.231.209 | Linux | PWS/1.1.29 | 22-Nov-2007 |
| Panther Express | 195.12.231.205 | Linux | PWS/1.1.25 | 2-Nov-2007 |
| Panther Express | 195.12.231.217 | unknown | PWS/1.1.22 | 31-Oct-2007 |
| Panther Express | 195.12.231.199 | Linux | PWS/1.1.22 | 29-Oct-2007 |
| Panther Express | 195.12.231.205 | unknown | PWS/1.1.20 | 19-Oct-2007 |
Apparently, webkinz team has been working very hard to accommodate the potential load, upgrading web server a couple of times within the last 2 months. Their hosts are running various version of PWS.
What kind of web server is PWS? I've never heard of it. After some search, I found out this definition on webopedia:
(2) When capitalized as Personal Web Server, the name of Microsoft’s Web server program for individuals hosting Web page files from a personal computer. Personal Web Server is a smaller-scale version of Microsoft’s IIS technology and is therefore limited in its capabilities. It is designed to support Web sites that obtain limited traffic and/or to be used as a staging server for building pages that will be transferred to a server that can handle large amounts of traffic.
Bold font are by me for emphasis. What a surprise and what a disappointment! A crippled version of IIS. (Note: This is in fact incorrect. Please see Jason's comments below about webkinz's network infrastructure.) That's what is powering the site that attracts millions of kids and parents around the globe. For millions of webkinzs Santa gave out last night, they can't really be played online. Then they are just a plain plush toy that is not even worth half the price. Sorry, Santa, I know it's not your fault, but can I exchange it for a walking doodle?
Seriously, the infrastructure of webkinz site is underdeveloped no matter how hard you upgrade or patch it. Here is a message to webkinz team, on behalf of my daughter, get some real hardware, now. Sun servers are quite affordable these days. For less than the price of 80 webkinzs (80*14.99=$1199.2), you can get a Sun Fire X2100 M2 server, two-way x64, high performance, and energy efficient, and free 60-day trial.
In addition, get the real OS, free. Get the real application/web server, be it Apache, Sun web server, or Glassfish.
Some of these may already on your wish list, and hopefully Santa already delivered some last night. But if Santa leaves a PWS/IIS under the Christmas tree, keep it for personal use.
Posted at 12:39PM Dec 25, 2007 by chengfang in Glassfish | Comments[36]
Stranger still: Panther's a CDN, like Akamai is. So that side's contracted out, and I wouldn't trust that "PWS" -- I bet the "P" stands for "Panther". (Besides, it says "Linux", too...)
Anyhow, I happened to see your screenshot on Bloglines' imagewall, and Webkinz is kind of an inside joke with my wife and I because I nearly applied there for a senior sysadmin position a couple months ago. I guess I'm glad I'm not working Christmas Day :-) But for what it's worth, that job posting (on Workopolis, no longer available) made them out to be a pretty straightforward Linux/Apache/PHP shop.
Merry Christmas -- I hope they get things sorted out so your daughter can get her chihuahua's adoption finished up soon!
Posted by Rich on December 25, 2007 at 01:16 PM EST #
Hi, Merry Christmas. Interesting post, but I don't think the blame should be on a personal web server for a Windows client OS. It clearly says in that report that this is a Linux OS, a cursory search of the net shows that "personal web server" is also used as a generic term for Linux as well so the wiki article you're relying on may not be deep enough to solve the mystery :-)
Hope your kids eventually get onto webkinz, it looks like the company did a poor job in estimating the traffic.
Take care and enjoy a few days off!
Andy
Posted by Andy on December 25, 2007 at 02:35 PM EST #
I am from Panther Express CDN - who serves some content on behalf of Webkinz.com. I wanted to clarify some questions or points that were unclear:
PWS stands for Panther Web Server which is our own cache-server built completely in-house by the Panther team - it is NOT a web-server (per se), and it is certainly NOT any variation of a Microsoft product. As you guys pointed out, our software runs on Linux and we are a CDN that is distributed network with more than 45 locations worldwide.
Webkinz does not run PWS, they run their own webservers. When a client goes to www.webkinz.com the DNS is CNAME'd to Panther's network (which serves up an IP based on your location and current network performance) and we then serve the webpage to the user. One part of this equation though is the back-end communication with the Webkinz servers for things like data retrieval for un-cachable data (first fetch, etc), authentication,certain js files, etc. Panther serves images and flash files within the game and on the splash page for Webkinz.
We are currently working with the very dedicated Webkinz team to alleviate the bottleneck that comes with the massive surge of new account traffic. And FWIW, I currently can get into webkinz fine to play with our pet, so keep trying :-).
Are you coming from the UK ChengFeng? If you have an IP address we can dig into the problem a bit more.
Hope this helps clear up some questions and thanks for your patience. Feel free to email me with any questions regarding Panther or CDN's (or this post).
Happy Holidays!
Jason Evans
Director of Operations
Panther Express CDN
Posted by Jason Evans on December 25, 2007 at 04:24 PM EST #
that message doesn't mean webkinz is down; it's just a warning. you can still click on "Log In" and everything.
Posted by lah on December 25, 2007 at 04:36 PM EST #
Ah, thanks for the follow-up Jason!
Posted by Andy on December 25, 2007 at 04:53 PM EST #
I don't believe PWS runs on Linux. It was strictly a Win 98 product (AFAIK). IIS is what is out there now for MS. Maybe the OS isn't really Linux or maybe the web server really isn't PWS. Regardless, Webkinz isn't WoW but it is a "free" web resource in that you don't pay a monthly fee for it. Kind of like free advice, it is worth what you paid for it :-)
Posted by Scott on December 25, 2007 at 05:21 PM EST #
Just something else I noticed. I did read the note from the Panther folks but the versioning number system is remarkably similar to Apache's (i.e it exactly the same). :-)
Posted by Scott on December 25, 2007 at 05:27 PM EST #
Thanks for all the comments and warm wishes. Jason's prompt and detailed explanation is also very helpful. I'm from Massachusetts, US, if that helps. This morning when my daughter first tried to log in, we did see the internal server error 500, and the warning as well. I tried a little later and was able to complete the pet adoption. The adoption process was pretty smooth except that one step had another server error that was resolved by clicking Ok again.
When she started to play games, the loading seems to take forever. My daughter started counting, up to 60, still loading. Then she went off to have snack. After the snack, it's still loading and so we went out to play snow. I promised to let her play the game tomorrow.
Posted by chengfang on December 25, 2007 at 10:11 PM EST #
Does anyone know when new users can set up accounts(estimated time?). I completely understand traffic issues and can just imagine how many excited kids are out there around the world wanting desperatley to explore the webkinz world. I am just curious to know the time-frame of when new members can get on site. Its such a great idea. My two children are so anxious to adopt their pets.
Thanks for any response:) Merry Christmas!
Posted by abaker on December 25, 2007 at 10:16 PM EST #
I have a hard time imagining a company with better information to facilitate load planning. You sew a plush, you make a hole. Three years of peak data, times the number of units sold = avoid embarrassment on the biggest single day in your history. Not exactly rocket science. My kids were able to login once today, but as soon as they touched anything, they were gone.
The input from Ganz's partner above is great, but with all due respect to the "dedicated" webkinz team, perhaps their management needs to dedicate some time to risk management and their own communication courtesy. They're a black hole - nothing ever comes out from anyone but their sales guys.
Posted by RW on December 26, 2007 at 12:06 AM EST #
RW has it spot on. I can't believe the people behind Webkinz couldn't have planned appropriately to handle the "large volume of traffic" that was absolutely guaranteed to occur on Xmas day and days following. I think Webkinz is a pathetic story of cynicism and bad management.
The marketing geniuses at Webkinz seem to have followed a three-step plan for getting rich at the expense of kids and their gullible parents:
Step 1: Spend money creating media hype about a blended virtual/real product, targeting kids too young to be jaded about cyberspace;
Step 2: Contract with Chinese sweatshops to crank out millions of plush pets for pennies apiece, and sell them for absurd prices on the strength of the media hype;
Step 3: Retire on a tropical island with few mirrors, so you can avoid facing your own greed-warped visage.
On the upside, maybe millions of kids will spend a little less time on the Internet now, and a little more time doing things like reading books and playing with toys that actually encourage independent thought.
Posted by hrangil on December 26, 2007 at 11:55 AM EST #
There are many other CDN's out there as well. I wonder what bandwidth level are you serving using CDN?
Posted by CDN on December 27, 2007 at 04:17 AM EST #
What exactly do you mean by "level"? We use a combination of many Tier1 and Tier2 ISP upstreams with multiple 10G ports at most locations. Panther certainly isn't capacity limited.
Posted by Jason Evans on December 27, 2007 at 09:54 AM EST #
Please see Important statement about the content of this post in the beginning, if you haven't.
Posted by chengfang on December 27, 2007 at 01:23 PM EST #
Terrible...how can you rip people off right this ?.
Thousands of kids will give up on this novelty before next week if they don't fix the problem.
I bought one for my daughter and haven't been able to log in once in a week...Not only on Xmas day.
Shame on Ganz for selling these toys without having a proper equipment/server ready.
Posted by WebNoKinz on December 27, 2007 at 02:41 PM EST #
Terrible...how can you rip people off like this ?.
Thousands of kids will give up on this novelty before next week if they don't fix the problem.
I bought one for my daughter knowing that this is just a bad idea..We haven't been able to log in once in a week...Not only on Xmas day.
Shame on Ganz for selling these toys without having a proper equipment or server ready.
Posted by WebNoKinz on December 27, 2007 at 02:43 PM EST #
Cheng,
I'd love to know how to turn email notification of comments *off*, now that this has sort of become Webkinz-complaint central! :-)
(Hopefully posting another comment with the box unchecked will do it. If not, could you please hit that switch for me?)
Posted by Rich on December 27, 2007 at 03:01 PM EST #
haha
Posted by anon on December 27, 2007 at 06:44 PM EST #
my children each got webkins for xmas. however for 2 days i keep getting logged of or we just get error messages: can not log on to webkinz right now try later.
what is up?
Posted by RACHEL on December 27, 2007 at 07:28 PM EST #
I wanted to show my friend my house
Posted by Abigail on December 27, 2007 at 08:11 PM EST #
My boys have had WebKinz since August this year, and the web performance has usually been good. My youngest son received a new WebKinz for Christmas. We encountered the server error during the Adoption, and since have not been able to do anything but login. I submitted a request for Support assistance, and received an automated email that I can expect help in 1-3 working days!!!
Ganz should have been prepared for this level of activity. I am very disappointed (not to mention my 5-year-old!) and I won't be recommending WebKinz to anyone anymore.
Posted by SadSanta on December 28, 2007 at 04:36 PM EST #
Santa brought my five-year-old a koala, and she was over the moon. Subsequent attempts to load the "room" result in us getting logged out each and every time, and yes, our flash player is up-to-date.
I found the near-impossibility of shooting off an actual descriptive e-mail to Ganz frustrating. I did manage finally, but have yet to hear a peep back. I have patience, yes, but should Ganz expect a five-year-old to understand that she was given (by Santa!) a gift which will not work? I explained to her that Ganz did a poor job with the website and she stated, "Maybe they just should make stuffed animals then."
Out of the mouths of babes, eh?
Posted by Robbi on December 30, 2007 at 01:36 AM EST #
My daughter received 2 Webkinz for Christmas, and we were able to get through the adoption with little difficulty, but have been restricted (on our computer, as well as my parents') to just the Arcade, Employment Office, Kinzville Academy, and the shops. Every time we try to load "my room", DiceKinz, the Tournament Arena, and other pages, we are automatically logged out.
I tried updating the Flash Player (and any other similar program I could think of), and we still get the same error. It is ludicrous that we cannot contact customer support and get a response (I received the auto-reply, but never was actually contacted within the 1-3 business days the auto-response stated...actually, I never was contacted at all). And, I definitely don't have any server issues. The room is one of the biggest parts of this "toy", and yet we are unable to get to it! Very frustrating...hope someone can provide some real feedback soon.
All the best...
Posted by Carolyn on January 04, 2008 at 04:42 PM EST #
Cheng, thans for the tech side of the issue. Jason, thanks for the detailed info.
Speaking of complaint central, I'm test driving a blog to give Webkinz owners a place to voice their complaints and kudos for Webkinz customer support. If enough people participate, maybe Ganz will take note.
Take care.
Posted by Lexie on January 04, 2008 at 05:14 PM EST #
My daughter also has a webkinz, that she got for Christmas, and it still doesn't have a room. This is very frustrating for her!
Posted by Casey on January 05, 2008 at 01:23 PM EST #
We had held off on registering, letting holiday dust settle. 3 1/2 days ago we tried. Registered, but couldn't go on. Couldn't even get to the newspaper to e-mail customer service. Since then we can access about half the stuff; but no room, actions, clubhouse... I e-mailed them 3 days ago, haven't heard anything yet.
Posted by Janice on January 07, 2008 at 09:39 AM EST #
Im in the toy business 25 years...the company is terrible..they dont care what you people think..honestly..and the reps are the worst to work with...they dont care either..they have made there millions already...but good news Ty Warner is going to make Beanie Babies an online pet...I always thought they were soft and cuddly more anyway..and he's just one guy..that invented them...not a company that makes you buy other things from them that you cant sell in your toy store..well off to Toy Fair in Feb..hope to find out more about the beanie babies
Posted by 205.188.117.130 on January 15, 2008 at 12:36 PM EST #
great opst.
famoust advertise .
Posted by muztagh on February 10, 2008 at 10:53 PM EST #
Interesting post ! but I don't think the blame should be on a personal web server for a Windows client OS.
Posted by Ice road on February 14, 2008 at 04:11 AM EST #
chloe and bitezo
why downt you show a tiger piter
Posted by 90.202.178.248 on April 10, 2008 at 01:26 PM EDT #
The Webkinz website is a horror! Tried to use "Contact Us" to report stuck items and other problems and encountered an entirely different problem: When we registered, we entered a 5 character Username, and it fulfilled the 4+ character requirement. We use this name to log on each time. However, when we attempt to contact them thru their format, we get an error message that the Username must be 6 or more characters! So there is no way we can use their system. It took DAYS to locate an e-mail address other than what they offer on their site. Now they just don't bother to answer the e-mail. Have you noticed some of the errors in the Quizzy area? In one of the Math sections, where the answer is to be "equation", the math problem given as an example is 5+2=10. Um...not the last time I learned it! There are several others of similar error. It's a very frustrating website, indeed!
Posted by Tunia on April 23, 2008 at 03:48 AM EDT #
off on registering, letting holiday dust settle. 3 1/2 days ago we tried. Registered, but couldn't go on. Couldn't even get to the newspaper to e-mail customer service
Posted by china tour on May 26, 2008 at 02:13 AM EDT #
Hello, you all Webkinz fans, I’m the Co-owner of webkinz, and if your tired of not having a enough money, the owner of webkinz told me a great solution for you. All your old codes that just lay there in your room can make you kinz cash, just email me at webkinz_smithd@yahoo.com and send your old codes, but make sure you give your username or i wont know what account to give the kinz cash to. Each code is worth 1000 kinz cash, so if you have 5 code you will get 5000 kinz cash.
Sincerley,
Mr.Smith
Posted by Daniel Smith on November 06, 2008 at 11:02 PM EST #
your site sucks
Posted by beave on November 08, 2008 at 10:28 AM EST #
you have the wrong code
Posted by Javannah on December 25, 2008 at 02:01 PM EST #
Well it it February, and there still is NO improvement. Yes, we are unfortunately tied to peak times (kids school, bedtime, etc.). I can't remember when I have found a more delightful site for the kids, yet it has gotten impossible to use. It doesn't appear to me that Ganz is truly working hard at infrastructure improvements. As a matter of fact, I am beginning to believe that they really don't care!
Posted by Lori Craig on February 23, 2009 at 07:13 PM EST #