beethogedeon/policy-area-Qwen3-0.6B

SetFit with Qwen/Qwen3-Embedding-0.6B

This is a SetFit model that can be used for Text Classification. This SetFit model uses Qwen/Qwen3-Embedding-0.6B as the Sentence Transformer embedding model. A LogisticRegression instance is used for classification.

The model has been trained using an efficient few-shot learning technique that involves:

1. Fine-tuning a Sentence Transformer with contrastive learning.
2. Training a classification head with features from the fine-tuned Sentence Transformer.

Model Details

Model Description

• Model Type: SetFit
• Sentence Transformer body: Qwen/Qwen3-Embedding-0.6B
• Classification head: a LogisticRegression instance
• Maximum Sequence Length: 32768 tokens
• Number of Classes: 16 classes

Model Sources

• Repository: SetFit on GitHub
• Paper: Efficient Few-Shot Learning Without Prompts
• Blogpost: SetFit: Efficient Few-Shot Learning Without Prompts

Model Labels

Label	Examples
Financial Sector	'Why would Argentina want to have the IMF reviewing its accounts every three months in Buenos Aires for the next two decades, asked a former technician of the multilateral organization.' 'The Bank’s Financial Policy Committee warns:\n\n“In the limited time remaining, it is not possible for companies on their own to mitigate fully the risks of disruption to cross-border financial services.”\n\nSounding the alarm over the complex financial derivatives - currently sold across the UK-EU border by banks to companies looking to protect themselves from movements in interest rates – the FPC said the EU needed to take urgent action to plan for Brexit.' "His ability to address these critical issues will largely determine Argentina's trajectory over the next decade."
Pensions	'Replying to a question regarding politics on the petrol price, Miftah said Nawaz Sharif and Shehbaz Sharif have taken up steps against their politics while deciding about the POL prices and similarly, the PPP, MQM and JUI-F preferred national interest over their political capital.' 'Zimbabwe allots $38mn at currency auction as local dollar weakens further\n\nThe Reserve Bank of Zimbabwe (RBZ) Reserve Bank of Zimbabwe (RBZ) foreign exchange auction on March 29 allotted $37.6mn to local companies, with most of the money to be used to import raw materials, machinery and equipment for industry.' 'If this is not done, with a new financing, inflation will not be stopped, nor will conditions be created to lower inflation, we will not grow, we will have price problems, probably shortages.'
Other	'The report concludes that the size of the predicted negative economic impact was considerably exaggerated in each case.' "Even this limited agenda would require negotiations with Europe and the IMF on reopening the terms of Greece's latest bailout package, including potentially resetting its fiscal targets." 'And “industrialisation,” Nayyar adds, refuting Friedman’s popular binary, “was not so much about getting-prices-right as it was about getting-state-intervention right.”'
Spending limit	'It believes inflation will be 2.9pc next year, compared with 2.2pc if the Government had stayed within its spending rules.' 'Success would have seen a return to the technocrat solution of November when former central banker Lucas Papademos, supported by New Democracy and Pasok, pushed through the 240 billion euro ($310 billion) EU-IMF bailout which staved off Greek bankrupcty.' 'Ukrsotsbank reported IFRS total assets of $6.4 billion at year-end 2008.\n\nVAB Bank reported -- under local accounting standards -- total assets of $1 billion as at year-end 2008.'
Governance and Anti-Corruption	'Therefore, according to the specifics, there is still a clear need to have exchange rate coverage, especially if foreign currency obligations or needs are in place.' 'In parallel, the government launched its priority ac-tion plan centered on three main pillars: to strengthen the rule of law and gover-nance; provide better public services; and propel economic growth, productiv-ity, and job creation.' '"You need law that is universal and then you need regulation that ensures that the application of that law is done in a way that is sensible towards society," says Mr Hourican.'
Energy Subsidy	'If truth be told boldly in the midst of engulfing economic crisis in the region, none of India’s neighbours is economically viable entities if the aspirational demands of their social media generations are to be met by a ‘welfare economic model’ with a democratic electoral scheme.' 'What is baffling is that the Prime Minister and the Finance Minister claim on the one hand that they are going to proactively go after high net worth individuals who do not pay income tax (though neither has focused on strengthening the farm income tax payable in provinces governed by Pakistan Tehreek-e-Insaf) while on the other hand, they continue to rely heavily on indirect taxes (budgeted this year to account for over 62 percent of total FBR collections).' "Within the textile group NML having the larger plant and higher capacity utilization level is expected to bear a larger burden than NCL where NML's annualized earnings are likely to compress by Rs0.15/share if the tariff increases by 5%."
Debts	"If your hours at your main job are cut in the New Year, you'll have your side gig to fall back on." 'Another parallel rate, known locally as the "blue dollar," approached a record 500 pesos to the dollar on the streets of Buenos Aires, according to dolarhoy.com, a widely used financial news website that tracks the peso.' 'The top gaining sectoral indices on the BSE were Capital Goods up by 1.67%, Metal up by 1.47%, Industrials up by 1.31%, Consumer Durables up by 1.14% and Healthcare up by 0.74%, while Telecom down by 0.38%, Energy down by 0.07% and Oil & Gas down by 0.02% were the top losing indices on BSE.'
Environment and Climate Change	'He hoped both sides would be able to cooperate on issues of common interest, such as Covid-19, global economic recovery and climate change.' "The core idea of green sustainable development advocated by ESG is highly consistent with China's new development concepts of innovation, coordination, green development, opening up and sharing, and coincide with the Five-sphere Integrated Plan\n\nLi Hui, executive vice president of Shenzhen Stock Exchange, said that at present, there are nearly 300 listed companies in the green low-carbon field on the stock exchange, with a cumulative equity financing of nearly 1 trillion yuan and a total market value of about 6 trillion yuan, accounting for about 20% of the total market value of listed companies in Shenzhen." 'ALSO READ: WB, AfDB pledges 100tri/- to fund Mission 300\n\nThe initiative aimed at addressing the countrys adverse impacts of climate change.'
Tax increase	'GLOBAL TAX ON MULTINATIONALS\n\nThe G20 has on the agenda of 11 July the proposal for a global tax on multinationals that was agreed by the G7 with a rate of 15% and which also obtained the approval of the Organisation for Economic Co-operation and Development (OECD) last week.' '"One interesting thing about excise for quick revenue generating measure, in changing the rate, you do not need to go through parliament and the whole process; this is an executive decision that can be made.' 'The Special Investment Facilitation Council (SIFC) has also been getting briefings from the FBR about its major drives to broaden the tax base and plug loopholes.'
Fiscal	'This is primarily owing to US$3.6bn of outflow from financial account as Chinese loan of US$2.34bn matured and portfolio investment outflows of US$0.4mn were realized during the month; contributing a sizeable portion of the US$5.0bn decline in Gross SBP Reserves during Mar-2022.' 'With the aim of reaching 1.3% next year, goal that the administration of Mauricio Macri agreed with the IMF, the Government will cut some 200,000 million pesos, while the governors will have to face a reduction of another 100,000 million pesos.' 'Substantive agreement, where possible, will advance global welfare.'
SOEs and Privatization	'Its previous controlling shareholder, the Co-op Group , has effectively washed its hands of the bank by writing down its 20pc stake to zero.' 'The Opposition Leader said the SJB has already decided to introduce a new political culture through the Local Government institutions and formulate a code of ethics for each Local Government member.' 'In summer 2009, XXI Century sold its stakes in this project for $5 million to Melon Real Estate, part of Melon Investment Group Ltd. of Yaroslavsky and Serhiy Pirozhnikov.'
External sector	'Pakistan produces around 2.5 million tons molasses annually which is mostly exported.' 'Source: The Associated Press\n\n'Do no harm'\n\nLagarde's "Do no harm" directive was based on preventing what she called self-inflicted economic harm, including through tariffs and other barriers.' 'TheMinistry of Finance emphasized that the policy of President Andrés Manuel López Obrador is not to increase the public debt as a proportion of the gross domestic product (GDP), so the actions have been aimed at this purpose, with the objective of not doing the same as previous governments, since this implied raising taxes and did not result in higher tax collection\n\n.The'
Social & Labor	'Its management and technical team is headquartered in Nairobi and has maintenance teams spread across the markets it serves.' 'In that sense, he said: "It was, as he said, the day we began to regain the efforts of the Argentines.' 'These steps will reduce the payroll bill by nearly 0.4% of GDP, the report said.'
Monetary Policy	'As the World Bank noted, government debt in EMDEs is estimated to have gone up by 9 percentage points in 2020.' "In that report, Rodrigues mentioned too said that Guyana's high rate of economic growth continues, steadily driven by the growing oil-production sector, and also notes that unemployment rates in the country have declined, while inflation rates have moderated." "In Economía they do not rule out a meeting between the two during the trip to Washington to discuss Argentina's difficulties and the impact of the global context."
Exchange Rate	'On July 2, 1987, General Babangida was forced to merge the first and second tier exchange market.' '0.51 0.702804\nLithuania Litas 2.5067 3.4528\nMoldova Leu 12.755 17.5119\nRussia Ruble 29.9761 41.2561\nTajikistan Somoni 4.3674 5.9391\nTurkmenistan Manat 2.85 3.923025\nUkraine Hryvnia 8.0024 10.98409\nUzbekistan Sum* 1530.74 2122.91\nEstonia Kroon 11.5252 15.6466\n\n\n©Source: Interfax\n\n*As of 15.02.2010\n\nCurrency USD JPY CHF GBP EUR\nUSD * * * 0.0110 0.9256 1.5578 1.3577\nJPY 90.6700 * * * 83.9200 141.2500 123.1100\nCHF 1.0804 1.1916 * * * 1.6832 1.4669\nGBP 0.6419 0.7080 0.5942 * * * 0.8715\nEUR 0.7365 0.8123 0.6817 1.1474 * * *\n\n\n©Source: Bloomberg\n\nUSD refers to the U.S. dollar, JPY – the Japanese yen, CHF – the Swiss franc, GBP – the UK pound sterling, EUR – the Euro.' 'Both Premadasa and Anura Kumara Dissanayake overlook the fact that Wickremesinghe, though not an elected President, was chosen for the job through the laid down Constitutional process and holds the office of President totally legitimately.'
Pro-market	'This historic action declares that the policy of our government is to aggressively promote and use American-made goods.' 'To reach the goal of upper middle income status, it will be important to boost the role for the private sector to serve increasingly as the main engine for growth and investment in Rwanda," he said.' 'The official avoided answering if the IMF will be paid on Friday: "We will know in the next hours, because everything depends on how the negotiation that is being carried out progresses".'

Evaluation

Metrics

Label	Accuracy
all	0.1790

Uses

Direct Use for Inference

First install the SetFit library:

pip install setfit

Then you can load this model and run inference.

from setfit import SetFitModel

# Download from the 🤗 Hub
model = SetFitModel.from_pretrained("beethogedeon/policy-area-Qwen3-0.6B")
# Run inference
preds = model("* Worsening external outlook makes Irish programme harder

(Adds quotes, details)")

Training Details

Training Set Metrics

Training set	Min	Median	Max
Word count	1	26.0004	2226

Label	Training Sample Count
Debts	1000
Energy Subsidy	1000
Environment and Climate Change	1000
Exchange Rate	998
External sector	1000
Financial Sector	1000
Fiscal	1000
Governance and Anti-Corruption	1000
Monetary Policy	1000
Other	1000
Pensions	1000
Pro-market	1000
SOEs and Privatization	1000
Social & Labor	1000
Spending limit	1000
Tax increase	1000

Training Hyperparameters

• batch_size: (8, 2)
• num_epochs: (1, 16)
• max_steps: 500
• sampling_strategy: oversampling
• body_learning_rate: (2e-05, 1e-05)
• head_learning_rate: 0.01
• loss: CosineSimilarityLoss
• distance_metric: cosine_distance
• margin: 0.25
• end_to_end: False
• use_amp: False
• warmup_proportion: 0.1
• l2_weight: 0.01
• seed: 42
• eval_max_steps: -1
• load_best_model_at_end: False

Training Results

Epoch	Step	Training Loss	Validation Loss
0.008	1	0.2978	-
0.4	50	0.2551	-
0.8	100	0.2506	-
1.2	150	0.2102	-
1.6	200	0.1617	-
2.0	250	0.1624	-
2.4	300	0.0558	-
2.8	350	0.0588	-
3.2	400	0.0423	-
3.6	450	0.0156	-
4.0	500	0.018	-

Framework Versions

• Python: 3.11.5
• SetFit: 1.1.3
• Sentence Transformers: 5.1.2
• Transformers: 4.53.3
• PyTorch: 2.7.0
• Datasets: 4.1.0
• Tokenizers: 0.21.1

Citation

BibTeX

@article{https://doi.org/10.48550/arxiv.2209.11055,
    doi = {10.48550/ARXIV.2209.11055},
    url = {https://arxiv.org/abs/2209.11055},
    author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
    keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
    title = {Efficient Few-Shot Learning Without Prompts},
    publisher = {arXiv},
    year = {2022},
    copyright = {Creative Commons Attribution 4.0 International}
}