How could citeproc support CSL-M layout?

[EroyalBoy]

When i make markdown to word by Pandoc , I met a question that i used CSL from (https://github.com/redleafnew/Chinese-STD-GB-T-7714-related-csl) ,then the references part in word are abnormality, which all cite twice such as

But i use this CSL in word by zotero macro ,which will be normal.

[jgm]

There's not enough information here for me to diagnose the issue.
If you attach files that suffice to reproduce the issue (together with the command used), I could take a look.
However, if the question is "does citeproc support CSL-M specific features?" then the answer is simply no. We only support standard CSL.

[EroyalBoy]

https://github.com/redleafnew/Chinese-STD-GB-T-7714-related-csl

the question is from zotero-chinese/styles#85 (comment)
your can try to use CSL from (Chinese-STD-GB-T-7714-related-csl) to test issue when markdown transform to word by pandoc

[jgm]

I'm sorry, I can't read Chinese. Can you give the complete pandoc command you're using to generate the output above, using the files in the linked repository?

[EroyalBoy]

I'm sorry, I can't read Chinese. Can you give the complete pandoc command you're using to generate the output above, using the files in the linked repository?

yes,i use this linked csl and command，like this

--citeproc --bibliography=/Users/chrisfang/文档/zotero/我的文库.bib --csl=/Users/chrisfang/Desktop/模板/CSL/main/009gb-t-7714-2015-numeric-bilingual-no-uppercase-page-out.csl

[EroyalBoy]

009gb-t-7714-2015-numeric-bilingual-no-uppercase-page-out.csl

this csl that You can also get from the linked https://github.com/redleafnew/Chinese-STD-GB-T-7714-related-csl/blob/main/009gb-t-7714-2015-numeric-bilingual-no-uppercase-page-out.csl

[jgm]

And where can I find 我的文库.bib?

[zepinglee]

Almost all citation styles in China are multilingual ones (mainly Chinese and English) and the cs:layout extension feature from CSL-M is important to implement that. See also https://github.com/Juris-M/citeproc-js/blob/master/fixtures/local/language_BaseLocale.txt. That's why redleafnew/Chinese-STD-GB-T-7714-related-csl is built for styles that cannot go into the official styles repository.

The issue can also be reproduced with the following contents.

main.md:

# Test

A Chinese entry [@ITEM-1].
An English entry [@ITEM-2].

# Bibliography

main.json:

[
	{
		"id": "ITEM-1",
		"type": "book",
		"event-place": "北京",
		"language": "zh",
		"publisher": "中华书局",
		"publisher-place": "北京",
		"title": "国史旧闻",
		"volume": "第 1 卷",
		"author": [
			{
				"family": "陈",
				"given": "登原"
			}
		],
		"issued": {
			"date-parts": [
				[
					"2000"
				]
			]
		}
	},
	{
		"id": "ITEM-2",
		"type": "book",
		"edition": "4",
		"event-place": "New York",
		"language": "en",
		"publisher": "McGraw-Hill",
		"publisher-place": "New York",
		"title": "Probability, random variables, and random signal principles",
		"author": [
			{
				"family": "Peebles",
				"given": "Peyton Z."
			}
		],
		"issued": {
			"date-parts": [
				[
					"2001"
				]
			]
		}
	}
]

009gb-t-7714-2015-numeric-bilingual-no-uppercase-page-out.csl is available from https://github.com/redleafnew/Chinese-STD-GB-T-7714-related-csl/blob/main/009gb-t-7714-2015-numeric-bilingual-no-uppercase-page-out.csl.

Command:

pandoc --citeproc --bibliography=main.json --csl 009gb-t-7714-2015-numeric-bilingual-no-uppercase-page-out.csl -o out.html main.md

out.html:

Test

A Chinese entry^[1]. An English entry^[2].

Bibliography

[1]

陈登原. 国史旧闻: 第 1 卷[M]. 北京: 中华书局, 2000[1]陈登原. 国史旧闻: 第 1 卷[M]. 北京: 中华书局, 2000.

[2]

Peebles P Z. Probability, random variables, and random signal principles[M]. 4 版. New York: McGraw-Hill, 2001[2]Peebles P Z. Probability, random variables, and random signal principles[M]. 4 版. New York: McGraw-Hill, 2001.

Each entry is repeated twice in the output.

[denismaier]

Oh, that's interesting. Pandoc's citeproc renders both layout nodes? Am I reading this correctly?

[jgm]

Thanks for the detailed report. Yes, from Citeproc.Style:

    let layouts = getChildren "layout" node'
    let formatting = mconcat $ map (getFormatting . getAttributes) layouts
    let sorts   = getChildren "sort" node'
    elements <- mapM pElement (concatMap allChildren layouts)

This just presupposes that there is only one layout element (I didn't know there could be more than one---but I guess that's just in CSL-M?). If there are multiple layouts, their children are just concatenated.

It would take some changes in the basic types to support multiple layouts, but I don't think it would be too complicated.

[jgm]

OK, it's not as easy as I thought. I've pushed some preliminary changes to the types and style parsing to the multilayouts branch.

But the problem I'm now facing is that the code for disambiguating, grouping and collapsing is sensitive to some of the options on layout, such as year suffix delimiter, after collapse delimiter, etc. I'm not entirely sure how to handle this if these attributes can vary from one bibliographic item to another, since grouping, collapsing, and disambiguating must be done holistically, not on an item by item basis. Any advice on that?

I'm also not sure I should even be proceeding in this direction. Is there any point to supporting multiple layout elements without supporting the rest of CSL-M?

Perhaps, instead, I should just modify the code so that only the last layout element is used. This would prevent double citations like the ones shown above.

[jgm]

I've made the more moderate change noted above, which at least avoids the doubled citations.

[badumont]

Why not raise an error when there are multiple layouts? After all, multiple layouts are not conformant to the specification targeted by your implementation. The error message would explain users why this does not work, which sounds better to me than falling back silently on a behaviour they don't expect.

[jgm]

Yes, maybe you're right that an error would be better here.