Geometric Schur duality of classical type [Appendix with H. Bao, Y. Li]