Based upon Mr. Crosby's autobiography titled "Call Me Lucky" and Mr. Gary Giddins' excellent biography of him titled "Pocket Full of Dreams," the sons from his first marriage (to Wilma Wyatt - aka Dixie Lee) were a mess. Mrs. Crosby was an alcoholic who died too young, just shy of 41 years of age. Mr. Crosby was away much of the time, either at Paramount, the recording studio, or the radio show stage. His desire was for these boys (Gary, Phillip and Dennis (the twins), and Lindsay) to have a "normal" childhood despite growing up in Hollywood, and that grow up to be useful members of society who could stand on their own legs rather than living his reputation and money.
To that end he used on them the strict discipline which he, himself, experienced throughout the course of his Jesuit schooling, and he made no secret of that. He also insisted that they be well mannered, punctual, responsible, and that they work (for an allowance) on the family's ranch in the summer. They did the latter, but grudgingly.
It is purported that Gary had a king sized chip on his shoulder from the time he was born. Further, all were apparently mediocre students who grew into adults who lived tumultuous lives, to say the least. Dennis and Lindsay both committed suicide. Gary died of cancer. Phillip lived the longest, and refuted much of what Gary claimed in his mommy-dearest-themed book titled "Going My Own Way."
That whole chapter of Mr. Crosby's life may be summed up in one word: sad.