Projectupdate:
January 30, 2026
- Phase 2/3 of MCM1 Validation Backlog Begins - last weekend into this week, we were able to successfully clear a few million more workunits from the MCM1 validation backlog without shutting down the BOINC database. Today, we have started the next phase, focusing on a different category of missed validations. As we run these validators on pre-compiled lists of result file pairs in parallel with the hot path (hot path uses the Kafka topics, firing result upload events so validator_assimilator daemons can batch up transactions of likely reported result pairs and try these "eligible" workunits efficiently), we have one more phase, Phase 3, planned for when Phase 2 completes. When Phase 2 and Phase 3 complete, that should "bring us current" to January 26th (most of the indexing was done on or before January 26th), and we can replay from the Kafka queues through the phase 1, phase 2, and phase 3 cleanup pipelines to get the rest from January 26th to the given day in February (should be a small fraction). The final "cleanup" phase will be re-evaluating workunits marked INVALID by each of the previous Phases 1-3, to see if recovery as VALID of some workunits with yet-more-relaxed criteria makes sense, especially given the large number of hr_class reset workunits we've been running to get around the host os_name and os_version issues from newer BOINC clients.
- We may still shutdown the BOINC database temporarily for MCM1 backlog validations - if we choose to do this to complete reconciliation, or to rollout the updated BOINC daemons based on the most recent server release 1.6.1, or go live with our distributed Postgres architecture to replace the current SQLite-per-partition architecture with a more robust, parallelizable backend, we will provide as much notice as possible. We will continue to reiterate this possibility while we are still considering it, as most services will not work if we take the database offline temporarily.
- BOINC db_dump for stats will resume once Phase 2 and Phase 3 backlog completes - we have not wanted to put out the stats, because we have not finished reconciling them from all the results that volunteers have uploaded, and we have not felt comfortable deleting results from the result table or result files from the caches or filesystems. We now know we can often credit retroactively, and once we are confident in our reconciliation of MCM1 backlog we will consider the pipeline and architecture stable, and resume db_dump stats dumps as before.
- We are pursuing upgrade to BOINC server release 1.6, which has the potential to fix the host os_version corruption issue (see https://github.com/BOINC/...ver_release%2F1.6%2F1.6.1) - we have seen entire error messages from the BOINC client end up in the os_name and os_version fields in addition to the most common case of a truncated single, first letter of the OS that should be recorded there. For example, "W" for Windows. While we cannot guarantee that this release will resolve the issue, and updating to it is still being assessed for feasibility and depends on other large upgrades, we are in a position to finally evaluate and attempt to switch off our legacy BOINC build to track upstream BOINC, and simply patch in the features required to maintain legacy continuity.
- MAM1, ARP1, MCM2 releases pushed back - the MCM1 validation backlog issues have stymied many of the cleanup processes required to keep adequate resources available to run multiple projects, especially with large upload sizes and local compute requirements like ARP1. We are in a position to release MAM1 workunits at any time. We have some scientific work to do before we begin distributing "MCM2" workunits using the same application MAM1 uses, as MCM1 batches. Once we are up to date with MCM1 backlog, and begin releasing stats, we will be ramping up other projects and begin approaching the frontend backlog.
bron:
JurisicaLab
[World Community Grid] hitparade van 30 januari
Total flushers: 62
More...
More...
More...
More...
Links
World Community Grid homepage
World Community Grid stats van alle Teams
World Community Grid stats van DPC
World Community Grid stats van DPC voor BOINC clients
Bron DPCH
Kuuke's Sterrenbeelden | 英俊的兔子
/u/29503/crop698e379eee134_cropped.png?f=community)
:strip_icc():strip_exif()/u/19107/JIS.jpg?f=community)
/u/21440/palm-tree-on-beach_60.png?f=community)
:strip_icc():strip_exif()/u/55606/crop5d09d7968a51e_cropped.jpeg?f=community)
)
3)
1)
)
