I don't know the AAC specs, so I don't know exactly how AAC-LC and AAC-LD differ. It's possible that AAC-LD may not be the best solution for your problem.
Since you want to use a codec for speech and there are low-delay speech codecs available (source code even) it might be a good idea to use one of those (e.g.
Speex).