Stefan Caunter

Plenty of fun the last couple of weeks with URL Rewrite. We’ve started using rewrite rules more in the past couple of months, and seen memory use go up. Like it’s eating it. w3wp.exe was getting to 3GB, and eventually exceeding 32 bit space. We adjusted IIS so the app pool recycled at 10 hours, or if the app pool private bytes size reached 2GB. Decent workaround, but we’re leaking memory like never before.
Conversations with an IIS engineer and a fair amount of tracing of the memory image and the processes led us to URL rewrite as the culprit.
Microsoft is not versioning very well with URL rewrite. The 1.1 you have may not be the latest 1.1! We found that 1.1 was actually 7.x and that we needed to “upgrade” to a later 1.1. Same thing though, memory leak. Version 2.0, an RC, was the next recommendation.
We found that uninstalling 1.1 removed all server level rewrite rules from applicationHost.config – fun! We always have a backup of that file though. You also need to reboot if you uninstall 1.1. Upgrading to 2.0 and restoring a previously working applicationHost.config breaks your server. 1.1 server level rules are incompatible – IIS7 complains about addservervariables not having a section. Whatever. I recreated the rules in the 2.0 interface from another server in the farm. Really wish MS had documented this difficulty, or at least warned that upgrading to 2.0 nukes your global rules.
Last, but not least, we learned also that server level rules actually run in every w3wp.exe process. At the time of this writing, we see that memory usage is much better with URL Rewrite 2.0. The folks on the URL Rewrite team seemed to acknowledge that memory leaks have been a problem for the module, and that itself meant that we were going to have to look at rolling out an upgrade across all production machines. Being able to copy out applicationHost.config to each server in a load balance pool is essential in this case. I don’t even want to think about doing hundreds of rewrite rules that are running on 1.1 and putting them onto 2.0. Not yet anyway.

So:  rewrite.dll, in C:\Windows\System32\inetsrv

Release  1.1 : Product Version 7.1.470.0 from April 15, 2009 – size 137KB

Release Candidate 2.0: Product Version 7.1.659.0 from November 4, 2009 – size 377KB

I first became aware of this phenomenon on youtube while looking for versions of Metric Help I’m Alive.

There’s a point in every one that’s worth watching where everyone, well, jumps. For joy. It’s a chance to be in a moment.

I’ve gotten back into them again looking for “Punk Rocker” by Teddy Bears on youtube. Fine, Sony has pulled everything. There are these killer cell phone videos of them playing amazing shows with different singers. Aimee Echo, Santi White. Fantastic.

Metric: http://www.youtube.com/watch?v=9iflyv60mIo http://www.youtube.com/watch?v=M3YuU8r2054 (not a cell phone vid but superb KCRW). I can’t listen to NPR anymore, but amazing upload (get it while you can kids).

Same I think for all cell phone vids. Ephemeral experience available for a while. Reminds me of mp3.com in 1998. Seemed like it would last forever. Live joy, jumping into your screen. Better than the official video. Listen for the people singing along and feel it.

If varnishd is now started with a -S secret-file argument, user connections are authenticated.

This solves the wide openness of the management access point to varnish. Usual workaround is to simply ssh to a shell on a restricted machine, but if you are running varnish on a system where there is shell access, any user can telnet to the management port and, well, manage varnish (by design).

This solution prevents that situation for hosting providers, and should allow wider deployments on multi-use non-dedicated servers.

http://varnish.projects.linpro.no/wiki/CLI

New: audio of David Ascher’s talk, “Open Messaging on the Open Internet ” at Open Web Vancouver June 2009. There is a cool bit about the guy who lost all his Facebook stuff because of their policy with respect to how they saw what his work was doing with his account. Evan Prodromou is audible at some point (discussion on federation).
They are mp3 conversions from audacity recordings made on my MBP, and unfortunately you can really hear me typing notes more than anything. It’s all there though. Content is Ascher’s, Creative Commons License as discussed.
Part 1 File size: 20725015 bytes
Part 2 File size: 8200871 bytes
Part 3 File size: 29154418 bytes