Star Entertainment Group—backed by Australian gambling billionaire Bruce Mathieson—is in talks to sell its resort complex in Brisbane to its Hong Kong partners as the cash-strapped casino operator seeks to raise fresh capital to shore up its finances.