In about 1896 James and his wife, Sarah Emily (nee Sparling) and 1st daughter Doris Emily (born) moved to Sydney. They lived at Searle Street, Petersham for many years and had the following children;
* Gladys Elizabeth Martha Grant - 1896
* Violet Grace Georginia Grant - 1896
* Nellie Iris Grant - 1900
* Olive Isobel Grant 1900
* Myrtle Jessie May Grant 1903
* Lillian Hazel Ruth Grant 1905
* James William Grant 1907
* George James Grant 1909
* Gladys Elizabeth Martha Grant - 1896
* Violet Grace Georginia Grant - 1896
* Nellie Iris Grant - 1900
* Olive Isobel Grant 1900
* Myrtle Jessie May Grant 1903
* Lillian Hazel Ruth Grant 1905
* James William Grant 1907
* George James Grant 1909