Principled Technologies Tests Windows Vista SP1

When Windows Vista was originally released just over a year ago Microsoft commissioned Principled Technologies to compare the overall responsiveness of Windows Vista to Windows XP SP 2 for some common business and home tasks. With the release of Windows Vista Service Pack 1 (SP1) Principled has updated their results. Principled Technologies concluded the following when comparing business scenarios:
  • Overall, Windows Vista SP1 and Windows XP performed comparably on most test operations. Performance differences between the two operating systems were typically less than a half second. Significant differences of over a second occurred on only nine of 128 measures; Windows Vista SP1 led on eight of those.
  • Windows Vista SP1 was noticeably more responsive after rebooting than Windows XP on several common business operations.
  • Overall, Windows Vista SP1 was more responsive than Windows Vista on most comparisons. Performance differences between the two operating systems were typically less than a quarter second.

Principled Technologies also concluded the following when comparing home scenarios:

  • Overall, Windows Vista SP1 and Windows XP performed comparably on most test operations. Differences were typically less than a half second.
  • Windows Vista SP1 was noticeably more responsive after rebooting than Windows XP on several common home operations.
  • Overall, Windows Vista SP1 and Windows Vista performed comparably on most test operations, with differences typically less than a half second.

To download a PDF of the two most recent reports, as well as the original ones from last year, go directly to the Principled Technologies website - http://www.principledtechnologies.com/Clients/Reports/Microsoft/microsoft.htm


Comments

  1. Posted on: February 28, 2008 at 3:08PM  

    Hoi,

    My cousin installed my Pc for me. I have windows vista 64 bit. On 23/02/2008 I got the option to download and install SP1 from windows update. But my friend did not get the option to install and has Vista 64 bit installed too.. So I don't understand... Is SP1 for Vista 64 out already? and is mine the full version ?

    Glen

  2. Posted on: February 28, 2008 at 5:19PM  

    i got vista sp1 rtm ive noticed slight performance gains you have to defragment to gain back performance though

    for about 4 days after install it was on par with rtm

    after 4 days i noticed it begin to get faster and more responsive then rtm

  3. Posted on: February 29, 2008 at 11:25AM  

    I have purchased and installed Vista Ultimate RTM, and it is the stupidist thing ever. Even with this service pack.

    I am sorry but after several years of development, this is Microsoft's breakthrough??? I am really disappointed. I have been a professional .NET developer for 6 years now and have always loved the platform and I was hoping Microsoft would do just as good a job on Vista. Microsoft Visual Studio 2005 and SQL Server 2005 work on Vista, but with SEVERAL ISSUES. At first, SQL Server 2005 wouldn't even start up, it would just disappear. After 3 hours of research, I found out that it did not have the necessary permisssions to run. Whatever happened to user-friendly warning messages, at the least????

    Breakthrough OS? What a joke!!! If I did not need Visual Studio and SQL Server, I would install one of the Linux distributions. I know they have Mono (.NET for Linux) and all, but nothing that comes close to Visual Studio and SQL Server.

    I will be installing Windows XP Pro again. What a waste of my money.

  4. Posted on: February 29, 2008 at 4:23PM  

    Apparently Principled Techmologies lives in a different world than I do. I'm the IT manager for a global company and I live in the world where last July we performed testing IN MICROSOFT'S OWN technology center. It failed miserably in the tests. No question....not a single test showed Vista in any glowing light. Applicaiton compatability was a major sore point - especially with the 64bit version. We loaded the latest service pack last week and haven't done a full series of tests, but we're seeing the same issues we saw before. Some things are improved a bit (networking) and some are even worse (our HP printers HATE Vista). All in all, XP trounces Visat on everything from single proc boxes running 512Mb to Duo-core laptops running 4Gb. We're pulling the plug on any OS upgrades until Windows 7.

    This wasn't just a whim - we spent two weeks trying to tune this and all we got was sluggishness, workarounds for nearly everything, and even the Microsoft employees themselves were ready to throw Vista out the window by the time we were done.

    So, I'm finding it simply a joke to come on here and see that some company has determined Vista runs just as fast? Funnny, funny, funny.

    "Overall, Windows Vista SP1 and Windows XP performed comparably on most test operations."

    Too funny. This reminds me of the dead parrot sketch from Monty Python...you know, where they just can't seem to understand the parrot is dead. That's Vista in a nutshell. It was a great experiment and I can see that a few people are having a great time with it. For myself and the rest of the corporate world (and I'm HARDLY alone in my thoughts and testing procedures) it's a flop.

  5. Posted on: February 29, 2008 at 6:04PM  

    When is this SP really going to be available to the home user?  I got a new PC for Christmas and was so happy to finally have Vista.  Since that day I've been in Vista H3LL!!  I have had to reformat 3 times.  I have lost all my valuable work.  I'm so disappointed.  I am a HUGE Microsoft fan.  But this Vista reminds me of a bad case of Windows ME deja vu.  Just as I fix one issue going on, another pops up.  Please, please tell me that this service pack is going to make Vista more stable.  And is there a way to turn off that wonderful security feature of allowing certain programs to open on request.  I mean, I don't know how someone can highjack an embroidery program and use it against me!

    Thanks!

    TTDALE <><

  6. Posted on: March 01, 2008 at 8:36AM  

    Hello Nick I'm new here and I got to read all the comments, and all that I can say is that I want all those wonderfull results of the team on my computer Now.

  7. Posted on: March 01, 2008 at 12:47PM  

    Nick- It appears obviously, after reading the testing procedures that Principled skewed the test results in favor of Vista. You even provided the hardware for the testing. If you read their pdf documents thoroughly, it's also clear that they threw out the results that showed XP winning in a number of cases as "unacceptable", but when Vista won the same tests those results were kept. What a bunch of bollocks! They also used Microsoft's specific testing procedures, which were designed to paint Vista in a positive light and were extremely limited in scope. This testing was performed by people that do not appear to have my best interests in mind. I don't know what the point of this test is other than to make Microsoft look foolish by having to pad test results.

    If only Principled could tell me why even though I'm running 4GB and a 2.5 ghz duo core my Vista performs like it's running on a 512mb machine with 1GB ram. Their tests contradict fact. Our staff and our students are very disenchanted with Vista.

  8. Posted on: March 01, 2008 at 4:09PM  

    Did this test include any Vista extras? Oh, wait...there aren't really any. Couldn't be bothered to keep promises, just change the description field like we're all idiots and would not notice? Nice way to continue to screw your customers royally. Microsoft, when are you going to give us the extras we paid for? What a rip off Vista is! Does anyone from Microsoft ever address these boards, or do they ignore them as thoroughly as they have their customers?

  9. Posted on: March 02, 2008 at 11:33AM  

    Vista STILL TODAY doesn't even fully work with Microsoft's own products.

    GPO's appear random. We'll assign an OU GPO and all the XP computers get it consistenly and every time without exception. only about 80% of the Vista machines get it. Reboot and suddenly Vista sees the GPO.

    the Exchange toolset won't even run at all on Vista64. When we get it to run in Vista32, it causes all sorts of .NET 2.x errors. XP runs it flawlessly.

    the UAC, rather than being helpful, just throws everything to the user to figure out and reduces our user functionality. This is the worst kind of programming. Rather than take any responsiblity to figure out the threat, it just passes the buck.

    Running Vista on any machine we have with less than 2 gig of memory is simply painful. It really stretches credibility when (as this article states) some Microsoft partner tells me differently.

    Compatability is STILL a major sore point. Random things like ATA drives not being recognized (didn't think that was possible in today's computing world), Hewlett Packard printers not working right (how could this be?), and even creative sound cards not working right or having pops and hisses (I never thought I'd see the day when a creative sound card did not work).

    Thrashing hard drives. Constantly. In the middle of the night, in the middle of the day, in the middle of a major presentation. You name it. Vista just thrashed and thrashed until we gave it more than 2 gig, but there was no compelling reason why, other than to stop thrashing, we had to deploy 2 gig of memory when everyone simply uses word and e-mail.

    All in all, Vista is a complete waste of time for me. I've spent weeks tuning, retuning, fixing, fixing the fixes, retuning, pulling hair out, etc. My next purchase will either be Windows 7 or a Macintosh. Right now, I'm leaning toward the Mac unless Microsoft can somehow pull a rabbit out of their @$$ and make Windows 7 everything that Vista isn't.

  10. Posted on: March 03, 2008 at 1:16PM  

    "Performance differences between the two operating systems were typically less than a quarter second."

    Over a year after the craptastic Vista was unleashed on all of us, service pack one still can't make Vista perform anywhere near it should without throwing twice the resources at it.

    Microsoft calls this progress. I call it disaster. I call it a double disaster in light of the e-mails that definitively show Microsoft had no interest in providing us a great experience, just bowing to Intel's lowest common denominator.

    There's a LOT of "lowest common denominator" issues surrounding Vista.