Starting and stopping an embedded Kafka instance for every test should be an even more significant factor to your test runs.
Have you considered using the Alpakka Kafka testkit which helps you to start embedded Kafka per test class instead of per test? See https://doc.akka.io/docs/alpakka-kafka/current/testing.html
Cheers,
Enno.