"Cache-Control: only-if-cached" fails when offline even if response is cached
Yes, this should be possible with HTTP's defined caching behaviour, but only if the browser supports the specification.
In Chromium's source, only-if-cached only seems to appear in third-party modules (only-if-cached package:chromium). This suggests that the header may not be supported by Chrome.