Flink will be very useful if it is embeddable in applications and can discover other nodes and cluster without relying on YARN or Hadoop. So it would be an idea to make it stand alone.
Flink works stand alone already, YARN is only optional (for convenience)
for those that have a YARN cluster already. The default setup guide
describes the stand alone mode.
Flink also runs embedded with virtually no memory and thread overheads.
That was one of the features in the latest release. See the collection
environment. More Documentation for that is coming...