It seems to you that the number of errors in their updates has increased Windows 10 τα τελευταία δύο χρόνια; Αν ναι, γνωρίζετε το γιατί; Αυτό το ερώτημα απαντά σε ένα πρόσφατο video former employee of Microsoft (Senior SDET) Jerry Berg, also known as Barnacules.
Berg has worked for Microsoft for 15 years and one of his roles was to design and develop tools and processes to automate tests in Microsoft's operating system. He left the company after the release of Windows 8.1.
So according to Berg, Microsoft has significantly changed its testing procedures over the last two years. The developer describes in detail how the tests were performed at the end of 2014 until the beginning of 2015, and how Microsoft's testing procedures have changed since then.
At 2014 / 2015, Microsoft employed an entire team dedicated to testing the operating system, structures, updates, drivers, and other code. The team consisted of many subgroups conducting tests and discussing bugs and issues in daily meetings. The tests were performed manually by each group but also through automated controls. If these changes passed the tests, then we could embed the code in Windows.
The teams performed the tests on "real" hardware in a laboratory through automated tests. There were different systems had different hardware components, e.g. processors, hard drives, video and audio cards and other components so that the company can cover a wide range of configurations of various systems. But it also helped to identify bugs that only affected certain hardware.
So Microsoft stopped using almost the entire Windows test team as it began preparing three different systems: Windows, Windows Mobile and Xbox as a single system. The company began moving most of the testing to virtual machines. This means that the tests have stopped being performed on real systems and many different hardware configurations.
Microsoft employees could then use Windows under development on their own computers. The main idea behind this was to find bugs outside of working hours. Berg states in the video that this is not as widely used as before.
The main data source, apart from the existing automated test systems, comes from telemetry and Windows Insiders. Windows Insider builds are installed on millions of devices, and Microsoft collects data from all of these devices by telemetry.
Εάν κάτι δεν λειτουργεί σωστά, η Microsoft λαμβάνει πληροφορίες για το τι και πως. Ένα από τα θέματα όμως που υπάρχουν με την συλλογή δεδομένων μέσω τηλεμετρίας είναι ότι είναι απλά δεδομένα. Τα δεδομένα δεν εξηγούν επακριβώς τα περισσότερα σφάλματα. Εάν κάτι δεν λειτουργεί σωστά, η Microsoft ενδέχεται να μην είναι σε θέση να διακρίνει τα σχετικά bits από τα δεδομένα τηλεμετρίας. Όσο για τους Insiders, άλλοι αναφέρουν τα προβλήματα και άλλοι όχι. Υπάρχουν και φορές που τα bugs φαίνεται να έχουν επιδιορθωθεί σε ορισμένα συστήματα των Insiders, αλλά αυτό δεν σημαίνει ότι ότι έχουν επιδιορθωθεί για κάθε διαμόρφωση hardware. Επιπλέον, αν και οι Insiders μπορούν να αναφέρουν σφάλματα, είναι γεγονός ότι δεν δίνουν όλες τις απαραίτητες πληροφορίες στη Microsoft, κάτι που δημιουργεί τεράστια προβλήματα στους προγραμματιστές που έχουν επιφορτιστεί με την επίλυση αυτών των ζητημάτων.
2014 / 2015, the Microsoft test team, was tasked with analyzing bugs and problems. This gave the developers the data they needed to solve them.
Today, Berg says there is only telemetry that developers are trying to analyze to figure out how to fix these issues. The patches that are running for client devices running Insider Builds cannot be properly controlled due to lack of experience. This creates new errors.
One of the main reasons why Microsoft stopped releasing new feature updates to everyone at the same time was that problems that had not been identified could affect a large number of company customers.
So to avoid massive protests like after the circulation Windows 10 in the 1809 version, Windows releases with gradual rollouts rather than massively through Windows Update.