The expectation for those two little kids can only be considered a part; precisely because these two kids may become a major force in the future, Sky Shadow doesn't want any complications in this matter and tries to avoid any unforeseen events.
In terms of talent, the two might be highly gifted, but catching up to him and Feng Yi's pace is unlikely. Catching up to him isn't something just anyone can achieve, nor is everyone fit for battle. No matter how excellent your genes or outstanding your talent, external restrictions can still apply, such as accidental death, poor innate constitution, or a lack of meticulousness in battlefield thinking—challenges that are hard to change.
Blade Warrior and Iman belong to external factors, and now, the two kids are still in the budding phase. If they stay here for too long, it may negatively affect their growth, fostering a lifestyle of laziness. Sky Shadow wants them to leave as soon as possible because of this concern.