Cannot get Group Settings pulled down from LDAP using the OU class

Cannot get Group Settings pulled down from LDAP using the OU (ObjecUnit) class Running on a 2003 Active Directory in a corporate environment. User authentication works fine.

These settings work OK, but use Security groups, which means dozens of uneeded groups and terrible organization
GroupFilter = objectClass=Group
GroupAttribute = sAMAccountName
PrimaryGroupAttribute = gidNumber
MemberAttribute = member
MemberIndirection = 1

What I tried to do was just pull the users out of the OU's they are in, which is perfectly organized, I can get a list of Groups based on OU name, but not the CN (users) that are inside of those OU's
GroupFilter = objectClass=OrganizationalUnit
GroupAttribute = ou
PrimaryGroupAttribute =
MemberAttribute = memberOf
MemberIndirection = 1