You can. This is how Opencode worked, but they are clamping down on that approach.

As someone else has mentioned, you can actually use SDK for programmatic access. But that happens within the CC wrapper so it isn't a true API experience i.e. it has CC tools.