summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
...
| * | | tor-dirserver: Rename `md` to `microdesc`Clara Engler2026-03-091-2/+2
| | | | | | | | | | | | | | | | | | | | This is better because it is returned by `ConsensusFlavor::Microdesc::name()`.
| * | | tor-dirserver: Fix extra info schemaClara Engler2026-03-091-7/+10
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This commit fixes some parts in the extra-info related part of the database schema. Most notably, it changes the semantic to indicate that the sha1 represents the unsigned part of the extra-info document. Likewise, it also ensures that the reference to an extra-info document must not be null with a plain consensus but null with a microdescriptor consensus.
| * | | tor-dirserver: Store unsigned SHA for descsClara Engler2026-03-091-12/+13
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This commit modifies the database schema to rename `sha1` and `sha2` to `unsigned_sha1` and `unsigned_sha2`. Network status consensuses refer to server descriptors by their unsigned sha1. Microdescriptor consensuses refer to microdescriptors by their sha2, which is always unsigned, so we adapt that name for consistency.
| * | | tor-dirserver: Remove foreign key from descriptor memberClara Engler2026-03-091-4/+8
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This commit removes the foreign key constraints from the `consensus_router_descriptor_member` in order to allow the insertion of the router descriptors contained in a consensus before the respective descriptors were fetched. This also allows to directly compute the missing descriptors in SQL, using a left join on this table on `router_descriptor` and obtaining the entries that are NULL.
| * | | tor-dirserver: Store sha1 for extra-infoClara Engler2026-03-091-2/+6
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This commit modifies the database schema by tracking the sha1 of the extra-info instead of the rowid. This makes generating queues and other things easier. It also removes the foreign key constraint in order to allow for an asynchronous retrieval and storage. Otherwise it would not be possible to store a router descriptor without having obtained the extra info first.
| * | | tor-dirserver: Use getters for meta structsClara Engler2026-03-093-13/+18
| | | | | | | | | | | | | | | | | | | | | | | | This approach is better in order to guarantee that invariants are not violated, such that the expiry timestamp not being earlier than the valid after one for example.
| * | | tor-dirserver: Derive Copy on database meta structsClara Engler2026-03-091-2/+2
| | | |
| * | | tor-dirserver: Implement Sha1Clara Engler2026-03-093-4/+13
| | | | | | | | | | | | | | | | | | | | This commit implements Sha1 for the database in order to use it for the fingerprints in authority key certificates.
| * | | tor-dirserver: Implement Sha3_256Clara Engler2026-03-093-8/+7
| | | | | | | | | | | | | | | | | | | | This commit implements Sha3_256 as a database type and uses it for stroing `ConsensusMeta::unsigned_sha3_256`.
| * | | tor-dirserver: Generic database hash implementationClara Engler2026-03-093-65/+71
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This commit moves the `DocumentId` implementation into a macro called `impl_hash_wrapper` that implements a hash type in a database compatible fashion. In our case, we implement this for `sha2::Sha256` and then type alias `DocumentId` to this new hash. Yes, we originally moved away from a type alias here, but I think this is fine because for the foreseeable future, we will continue to use a hash here, just maybe not Sha2, but the flexibility remains. The motivation for this is to support other hash algorithms similarly too.
| * | | tor-dirserver: pub(crate) for ConsensusMeta::lifetimeClara Engler2026-03-091-1/+1
| | | |
| * | | tor-dirserver: Move AuthCert to databaseClara Engler2026-03-092-573/+263
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This commit moves get_recent_auth_certs from operation to database by introducing a new struct called `AuthCertMeta` containing the database metadata alongside an accompanying data method returning the raw data. For now, it leaves out the download, verify, and insert logic. We will add that back later once we will need it.
| * | | tor-dirserver: Rename Consensus to ConsensusMetaClara Engler2026-03-092-27/+35
| | | | | | | | | | | | | | | | | | | | | | | | | | | | This commit renames the database `Consensus` to `ConsensusMeta` in order to not collide with the naming from tor-netdoc and to clearly indicate that this data is just metadata about such a document, but not the document itself.
| * | | tor-dirserver: Use database as dbClara Engler2026-03-091-4/+4
| | | | | | | | | | | | | | | | Makes things more handy to write.
| * | | tor-dirserver: Avoid super in testsClara Engler2026-03-091-54/+44
| | | | | | | | | | | | | | | | | | | | If is annoying to use, especially if we can avoid it by just avoid name conflicts.
| * | | tor-dirserver: `use crate::database::Consensus`Clara Engler2026-03-091-3/+3
| | | |
| * | | tor-dirserver: Move db constants to the topClara Engler2026-03-091-172/+172
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Right now, it is a bit unfortunate that we have the very long schema string between two code blocks. It is probably better to either have it at the top or the bottom of the file, hence why this commit moves it to the top.
| * | | tor-dirserver: Move sync timeout to databaseClara Engler2026-03-092-55/+38
| | | | | | | | | | | | | | | | | | | | This commit moves calculate_sync_timeout into the Consensus struct in the database module, as it fits better there.
| * | | tor-dirserver: Remove serve functionClara Engler2026-03-092-129/+2
| | | | | | | | | | | | | | | | | | | | This commit removes the operation serve function because it no longer fits into the new model of operation using a FSM.
| * | | tor-dirserver: Refactor consensus retrieval logicClara Engler2026-03-092-260/+324
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This commit moves the get_recent_consensus logic to the database module, which also introduces a struct querying all fields in it. This not only simplifies the return type but also makes working with this type more comfortable to work with.
| * | | tor-dirserver: docid as consistent foreign keyClara Engler2026-03-091-10/+10
| | | | | | | | | | | | | | | | | | | | | | | | This commit replaces occurrences of rowid with docid, particularly in tables for N:M cardinalities. Purpose of this is, to achieve a greater consistency with the overall database schema.
| * | | tor-dirserver: Return Timestamp in consensus queryingClara Engler2026-03-091-17/+10
| | | | | | | | | | | | | | | | | | | | This is more useful and less boilerplate, removing a parameter for a conversion we can do ourselves if required.
| * | | tor-dirserver: Scratch out the FSMClara Engler2026-03-092-5/+493
|/ / / | | | | | | | | | | | | | | | | | | This commit scratches out the FSM for the dirmirror operation. Right now, there are still lots of TODO, lots of code warnigns, and such. It should model the rough concept.
* | | Merge branch 'chutney-test-to-py' into 'main'Jim Newsome2026-03-057-103/+218
|\ \ \ | | | | | | | | | | | | | | | | chutney test: convert shell scripts to python See merge request tpo/core/arti!3735
| * | | Document tests/chutney/config.pyJim Newsome2026-03-051-0/+13
| | | |
| * | | python lints: install chutneyJim Newsome2026-03-041-3/+4
| | | | | | | | | | | | | | | | | | | | mypy needs it to correctly type-check the chutney test scripts, which now import chutney as a module
| * | | chutney test: bump CHUTNEY commit and update to test all endpointsJim Newsome2026-03-042-52/+63
| | | | | | | | | | | | | | | | | | | | | | | | | | | | chutney replaced Node.socksport (a single optional port) with Node.socksport_endpoints (a sequence of bound addresses and ports). Update for compatibility, and test all of the exposed endpoints where relevant.
| * | | chutney test: test all relevant clients, not just an arbitrary oneJim Newsome2026-03-041-53/+56
| | | |
| * | | chutney test: don't shell out to chutney for 'verify' testJim Newsome2026-03-041-2/+3
| | | |
| * | | chutney test: drop jq dependencyJim Newsome2026-03-043-27/+1
| | | |
| * | | chutney test: use chutney module to inspect NetworkJim Newsome2026-03-041-29/+31
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Gets rid of shelling out to jq. We could also accomplish that with the json module, but this way also gives us: * Better error detection and handling. In particular this lets mypy statically detect trying to access fields of the wrong name or type. It will also make it easier to bump to the latest chutney, which has replaced `socksport` with `socksport_endpoints`, which would be more difficult to work with as json, especially via `jq`.
| * | | chutney test: move some common functionality into a moduleJim Newsome2026-03-043-14/+22
| | | |
| * | | chutney test: convert to pythonJim Newsome2026-03-042-39/+103
| | | |
| * | | chutney bootstrap: convert to pythonJim Newsome2026-03-042-11/+32
| | | | | | | | | | | | | | | | | | | | This is primarily a proof-of-concept for converting these scripts before tackling the more complext 'test' script.
| * | | chutney test: dump config as json, for use by python scriptsJim Newsome2026-03-042-1/+8
| | | |
| * | | chutney Config: use json-friendly typesJim Newsome2026-03-042-10/+10
| | | | | | | | | | | | | | | | | | | | In particular, use `str` instead of `Path`, so that it's directly encodable and decodable by the json module.
| * | | chutney CI: move config class to a module for reuseJim Newsome2026-03-042-10/+20
| | | |
* | | | Merge branch 'nonblocking-rpc-part3' into 'main'Nick Mathewson2026-03-058-213/+1008
|\ \ \ \ | | | | | | | | | | | | | | | | | | | | rpc: API for event-driven IO. See merge request tpo/core/arti!3652
| * | | | rpc: edit and revise EventLoop documentation.Nick Mathewson2026-03-051-7/+8
| | | | |
| * | | | rpc: Transpose Results in RpcPoll::poll.Nick Mathewson2026-03-051-7/+5
| | | | |
| * | | | rpc: document when try_as_{fd,socket} can fail.Nick Mathewson2026-03-051-1/+11
| | | | |
| * | | | rpc: Usage documentation for polling APIIan Jackson2026-03-053-22/+168
| | | | |
| * | | | rpc: Propose to transpose a Result<Result<>>Ian Jackson2026-03-051-0/+2
| | | | |
| * | | | rpc: Add a question in the form of a TODOIan Jackson2026-03-051-0/+2
| | | | |
| * | | | rpc: Fix many long lines in docs and commentsIan Jackson2026-03-054-22/+44
| | | | |
| * | | | rpc: Fix two mis-formatted json! blocksIan Jackson2026-03-051-2/+13
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | rustfmt doesn't like to touch things inside macros. These were misformatted as a result, with long lines and in one case a missing space.
| * | | | rpc: Remove WantIo and expose wants_to_write().Nick Mathewson2026-03-053-43/+21
| | | | |
| * | | | rpc: Change Waker implementation to EventLoop.Nick Mathewson2026-03-057-112/+151
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Per discussion, it makes more sense to have the API be one that gets called when our IO interests change. Additionally, this commit removes the try_reading and try_writing booleans, as previously discussed. I've left a couple of XXXX comments where more documentation or thought is likely needed.
| * | | | rpc: API for event-driven IO.Nick Mathewson2026-03-055-21/+245
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This API provides the necessary functionality to use an RpcConn inside a poll-like event loop. This is part of #1856.
| * | | | RPC: Explain why UserTag is a separate type.Nick Mathewson2026-03-051-0/+8
| | | | |