1. ade14e2 by showard · 16 years ago
  2. 324bf81 by showard · 16 years ago
  3. 2fa5169 by showard · 16 years ago
  4. d1ee1dd * move some scheduler config options into a separate module, scheduler_config by showard · 16 years ago
  5. 170873e Attached is a very large patch that adds support for running a by showard · 16 years ago
  6. e58e3f8 Set HQEs to "Verifying" instead of "Starting" when we're about to run verify on them. We need to set them to an active status, but if we use "Starting" then we can't tell which stage they're in, and we need that information to know when to "stop" synchronous jobs. by showard · 16 years ago
  7. 8fe93b5 Make CleanupTask copy results to job dir on failure. Did this by extracting code from VerifyTask into a common superclass. by showard · 16 years ago
  8. e788ea6 -make get_group_entries() return a list instead of a generator, since all callers want it that way anyway by showard · 16 years ago
  9. e77ac67 Set queue entries to "Starting" when the VerifyTask is created for them. This perennial source of problems cropped up again in the latest change to the job.run() code (as part of the synch_count changes). by showard · 16 years ago
  10. 2bab8f4 Implement sync_count. The primary change here is replacing the job.synch_type field with a synch_count field. There is no longer just a distinction between synchronous and asynchronous jobs. Instead, every job as a synch_count, with synch_count = 1 corresponding to the old concept of synchronous jobs. This required: by showard · 16 years ago
  11. 9d9ffd5 don't reboot hosts when aborting inactive jobs. by showard · 16 years ago
  12. 45ae819 Add a formal cleanup phase to the scheduler flow. by showard · 16 years ago
  13. fa8629c -ensure Django connection is autocommit enabled, when used from monitor_db by showard · 16 years ago
  14. 97aed50 Rewrite final reparse code in scheduler. the final reparse is now handled by a separate AgentTask, and there's a "Parsing" status for queue entries. This is a cleaner implementation that allows us to still implement parse throttling with ease and get proper recovery of reparses after a system crash fairly easily. by showard · 16 years ago
  15. 9886397 Add job start timeout for synchronous jobs. This timeout applies to synchronous jobs that are holding a public pool machine (i.e. in the Everyone ACL) as "Pending". This includes a new global config option, scheduler code to enforce the timeout and a unit test. by showard · 16 years ago
  16. 3dd6b88 Two simple scheduler fixes: by showard · 16 years ago
  17. 0fc3830 Add user preferences for reboot options, including simple user preferences tab which could later be expanded to include more options. by showard · 16 years ago
  18. 21baa45 Add options to control reboots before and after a job. by showard · 16 years ago
  19. 1be9743 -fix bug with handling abort on unassigned host queue entries by showard · 16 years ago
  20. 364fe86 Refactor the basic environment setup code out of django_test_utils.py into setup_django_environment.py, and rename django_test_utils.py to setup_test_environment.py. Also changed the environment setup code to run at import time. This makes it easy for scripts, both test and non-test, to use Django models without running through manage.py. The idea is that scripts will import setup_django_environment before importing Django code (somewhat akin to common.py), and test code will subsequently import setup_test_environment. by showard · 16 years ago
  21. 9976ce9 -make monitor_db implement "skip verify" properly, and add unit tests for it by showard · 16 years ago
  22. b2e2c32 -refactor Job.run in monitor_db, one of the most important and most confusing methods in the scheduler. it's now broken into separate synchronous and asynchronous paths with common methods extracted. by showard · 16 years ago
  23. 12bc8a8 The scheduler unit test needs to pass in a created_on time. by showard · 16 years ago
  24. b1e5187 Get the scheduler unittest to run against SQLite! by showard · 16 years ago
  25. 442e71e Move migration system into database/ directory. by showard · 16 years ago
  26. 0e73c85 Add a generic database wrapper, supporting different database backends, to be used by migrate, scheduler, parser (eventually), and maybe others. This will consolidate the multiple database wrappers we have throughout the code and allow us to swap in SQLite for MySQL for unit testing purposes. by showard · 16 years ago
  27. 989f25d two new major features: by showard · 16 years ago
  28. 50c0e71 -add --force option to migrations to disable user confirmation because this can make migrations unscriptable by showard · 16 years ago
  29. 4c5374f -modify scheduler throttling code to track number of running processes rather than just number of running agents. note this is only an estimate of running processes - it counts all agents as one process unless the agent is a synchronous autoserv execution, in which case it uses the number of hosts being run. by showard · 16 years ago
  30. 63a3477 -Refactor new monitor_db scheduling algorithm into it's own class by showard · 16 years ago
  31. 56193bb -add basic abort functionality test to scheduler unit tests. this by showard · 16 years ago
  32. dd70371 I left some debugging code in monitor_db_unittest.py. This goes with a patch I sent out a few minutes ago. so it should be applied after it. It was a patch to monitor_db_unittest as well. by mbligh · 16 years ago
  33. 3e0f7e0 Need changes to fix the monitor_db unittest by mbligh · 16 years ago
  34. c160352 Fixed the logic in the scheduler unit tests. Checks that the command by mbligh · 16 years ago
  35. fb7cfb1 Add support to the scheduler to pass in the host.protection value as by jadmanski · 16 years ago
  36. 5df2b19 Updating the RPC interface and scheduler unit tests to match up with by showard · 16 years ago
  37. f40cf53 Fixed the monitor_db_unittest to be more robust. When checking that the command line is correct should by mbligh · 16 years ago
  38. 0afbb63 Convert all python code to use four-space indents instead of eight-space tabs. by jadmanski · 16 years ago
  39. 3d161b0 Move the mock libraries from client/unittest into client/common_lib/test_utils. by jadmanski · 16 years ago
  40. 20f4706 -check ACLs directly in the scheduler (bypassing ineligible_host_queues) by showard · 16 years ago
  41. 04c82c5 Rewrite scheduling algorithm to use two queries + some data processing, rather than a separate query for each "idle" host. This should be considerably faster. It also gives us the opportunity to eliminate the whole ACL checking with ineligible_host_queues thing, which has been a nightmare. But one step at a time... by showard · 16 years ago
  42. ce38e0c The beginning of a unit test for the scheduler. Right now it only tests the job scheduling algorithm (i.e. Dispatcher._find_more_work() and the methods it uses). by showard · 16 years ago