LondonPrivacy training’s accuracy loss is partly just the wrong network shape.
Whether an institution can train on records it holds in trust depends on that penalty.
Differentially private training clips and noises every gradient, damaging large layers most, so researchers designed architectures built for that noise.
SENAS beat standard designs on four benchmarks, but the manuscript isn’t finalized yet.
Sources: Nature