Member scraping doesn't work

[LostXOR]

I'm trying to fetch all the members in several guilds with guild.fetch_members(). For guilds that I have moderator permissions in, this works fine. However if I use guild.fetch_members(force_scraping = True) or run it on a guild I don't have moderator permissions in, it returns an empty list. I think the way members are scraped from the sidebar is broken.

[TheOnlyWayUp]

Guilds are chunked by the time on ready is complete, if my memory serves me right, is guild.members empty before fetching members?

[dolfies]

Can you show the error logged? You probably need to manually specify channels.

[LostXOR]

Is there a version newer than 2.0.0a2? I redownloaded it from github and it's still the same version.

[dolfies]

The version number isn't updated but new commits are pushed. Are you installing from the rebase or master branch?

[LostXOR]

The master branch.

[LostXOR]

Should I create an issue from this discussion?

[dolfies]

Go ahead.

[jbaumgarten]

I tried to use the code `import discord, logging
logging.basicConfig(level=logging.INFO)

client = discord.Client()

@client.event
async def on_ready():
for guild in client.guilds:
if guild.name == "":
members = await guild.fetch_members()
print(len(members))

client.run("token")`

However, the function fetch_members seems not exist in object guild. Is there any breaking changes?

[jbaumgarten]

I just update the discord.py-self to version 2.0.0a2 and now the fetch_members exists but fails
python test.py WARNING:discord.client:PyNaCl is not installed, voice will NOT be supported. INFO:discord.client:Logging in using static token. INFO:discord.http:Found user agent Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/103.0.0.0 Safari/537.36 (103.0.0.0), build number 138734. INFO:discord.gateway:Gateway has sent the IDENTIFY payload. INFO:discord.gateway:Connected to Gateway: ["gateway-prd-main-6mr8",{"micros":502809,"calls":["discord-sessions-blue-prd-2-48",{"micros":483405,"calls":["start_session",{"micros":307472,"calls":["discord-api-f8dd45c-8kqj5",{"micros":279626,"calls":["get_user",{"micros":41566},"add_authorized_ip",{"micros":12594},"get_guilds",{"micros":18885},"private_channels",{"micros":99948},"read_states",{"micros":19297},"coros_wait",{"micros":30812},"aliases",{"micros":10124},"affine_user_ids",{"micros":758},"experiments",{"micros":11249}]}]},"guilds_connect",{"micros":4308,"calls":[]},"presence_connect",{"micros":1,"calls":[]}]}]}] (Session ID: b39b28c34d8811c60124936fa3e65126). WARNING:discord.state:Member list scraping failed for 893416252939317249 (failed to choose channels or ranges). WARNING:discord.state:Member list scraping failed for 643026568041594880 (failed to choose channels or ranges). Ignoring exception in on_ready Traceback (most recent call last): File "/root/anaconda3/envs/web3/lib/python3.10/site-packages/discord/client.py", line 381, in _run_event await coro(*args, **kwargs) File "/root/python/test.py", line 9, in on_ready members = await guild.fetch_members() File "/root/anaconda3/envs/web3/lib/python3.10/site-packages/discord/guild.py", line 3649, in fetch_members raise ClientException('Fetching members failed') discord.errors.ClientException: Fetching members failed

[dolfies]

Failed to choose channels or ranges. You need to manually pass at least one channel that is more or less viewable by everyone.

[jbaumgarten]

Failed to choose channels or ranges. You need to manually pass at least one channel that is more or less viewable by everyone.

I tried to fetch channels list first, then the members list but it fetchs 0 member
`import discord, logging
logging.basicConfig(level=logging.INFO)

client = discord.Client()

@client.event
async def on_ready():
for guild in client.guilds:
if guild.name == "GUILD:
channels = await guild.fetch_channels()
members = await guild.fetch_members(channels=channels, force_scraping=True, cache=False)
print(len(members))

client.run("TOKEN")`

I also tried
`client = discord.Client()

@client.event
async def on_ready():
for guild in client.guilds:
guild = client.get_guild(guild.id)
print(guild.name, len(guild.members), guild.member_count)

client.run("Token")`

It provides members if member_count is less than 1k members. Over, it has a small part of members

Finally, I tried to iterate channels list in order to find channel I have correct rights to read it.
for channel in guild.text_channels: if channel.permissions_for(guild.me).read_messages: members = await guild.fetch_members(channels=[channel])
I should create list of 5 channels to fetch members but it returns 0 member when I fetch a list of several channels

[jbaumgarten]

@dolfies In class MemberSidebar, get_channels method, the loop shouldn't it be
while len(ret) < amount and channels: channel = channels.pop() for role in guild.roles: if not channel.permissions_for(role).read_messages: continue else: for ow in channel._overwrites: if ow.is_member(): allow = Permissions(ow.allow) deny = Permissions(ow.deny) overwrite = PermissionOverwrite.from_pair(allow, deny) if not overwrite.read_messages: break ret.add(channel)

rather than
while len(ret) < amount and channels: channel = channels.pop() for role in guild.roles: if not channel.permissions_for(role).read_messages: break else: for ow in channel._overwrites: if ow.is_member(): allow = Permissions(ow.allow) deny = Permissions(ow.deny) overwrite = PermissionOverwrite.from_pair(allow, deny) if not overwrite.read_messages: break ret.add(channel)

If one channel is not readable, there is no more iteration on channels list