Index Metadata¶
Overview¶
The description about index, captured from Investopedia 1
An index is a method to track the performance of a group of assets in a standardized way. Indexes typically measure the performance of a basket of securities intended to replicate a certain area of the market.
Based on research, we designed this ERD concept related to index. Each of index has been create, manage, authorize by the exchange by issue the ground rules then make the index.
---
title: ERD of Index
---
erDiagram
EXCHANGE ||--|| GROUND-RULES : issue
GROUND-RULES ||--|{ INDEX : create
INDEX ||--|{ CONSTITUENT : has
CONSTITUENT ||--}| TICKER : has
INDEX ||--|{ PROFILE : has
PROFILE ||--o{ GROUND-RULES : related
TICKER }|..|{ METADATA : contain
Implement¶
Index Profile¶
Each index has a profile that described the attributes of index like name, methodology of tracking, calculate method,... This required to authorized by exchange and has the ground rules related to that index.
At this point, currently we focus on Vietnam market, which has 2 stock exchange:
-
Ho Chi Minh Stock Exchange [Code: HOSE, shortcut: HSX]. Website: Official HSX website
-
Hanoi Stock Exchange [Code: HANO, shortcut: HNX]. Website: Official HNX website
Let take an example frrom the introduction of Hanoi Stock Exchange:
HNX Indices are built based on the methodology in the Ground Rules of HNX Indices. Constituent stocks are selected from all the Hanoi Stock Exchange (HNX) stocks on the listed stock market or UPCoM and classified according to Hanoi Standard Industry Classification (HaSIC). A copy of the Ground Rules of HNX Indices is available on the website hsx.vn
Indices are calculated in Vietnamese Dong in real time and publicly disseminated by HNX on HNX Website, HNX Online trading board, Infoshow and directly distributed to data vendors and to securities companies… Based on the demand of each vendor, information on HNX indices can be subject to different delays. The delay of HNX indices’ information on HNX Website, Online trading board of HNX and Infoshow is by default 15 minutes. The Base date and base Index value of each index is specified in the Appendices.
Unless specifically detailed in this document, the methodology for the index maintenance in the Ground Rules is applied to all other HNX Indices.
The Hanoi Stock Exchange owns the copyrights for HNX indices including their names, constituents, industry classification and index calculation methodology Any copies or reprints of this document or any part of this document, for commercial purposes or any other purposes without the prior approval of the HNX are considered copyright violations and are prohibited.
The official opening and closing hours of HNX Indices are established to be same as the opening and closing hours of HNX stock market.
Ground Rules:
For HNX: Follow Index Methodology Disclosed
For HNX: Follow Introduction of Index
Note
Both the exchange just disclosed the version in Vietnamese language, not available for English.
The HNX has shortcut some English routes on their website
For basket of index, there are total of 41 indexies. There are exists cross exchange index - mean that index designed, managed by multiple exchange, example are VNXALL and VNX50. The X
character represented for CROSS
Table: Oversee Index [Updated at Feb, 24, 2023]
Code | Index Type | Long Name | Authorized By | Number Constituents Type |
---|---|---|---|---|
VNALL | price_index | Vietnam All Share Index | HSX | flexible |
VN100 | price_index | Vietnam 100 | HSX | fixed |
VN30 | price_index | VN30 Index | HSX | fixed |
VNMID | price_index | Vietnam Mid Cap Index | HSX | fixed |
VNSML | price_index | Vietnam Small Cap Index | HSX | flexible |
VNDIAMOND | price_index | Vietnam Diamond Index | HSX | flexible |
VNFINLEAD | price_index | Vietnam Leading Financial Index | HSX | flexible |
VNFINSELECT | price_index | Vietnam Financial Select Sector Index | HSX | flexible |
VNSI | price_index | Vietnam Sustainability Index | HSX | fixed |
VNCOND | price_index | Viet Nam All Share Consumer Discretionary | HSX | flexible |
VNCONS | price_index | Viet Nam All Share Consumer Staples | HSX | flexible |
VNENE | price_index | Viet Nam All Share Energy | HSX | flexible |
VNFIN | price_index | Viet Nam All Share Financials | HSX | flexible |
VNHEAL | price_index | Viet Nam All Share Health Care | HSX | flexible |
VNIND | price_index | Viet Nam All Share Industrials | HSX | flexible |
VNIT | price_index | Viet Nam All Share Information Technology | HSX | flexible |
VNMAT | price_index | Viet Nam All Share Materials | HSX | flexible |
VNREAL | price_index | Viet Nam All Share Real Estate | HSX | flexible |
VNUTI | price_index | Viet Nam All Share Utilities | HSX | flexible |
VN100_TRI | total_return_index | Viet Nam 100 Total Return Index | HSX | fixed |
VN30_TRI | total_return_index | Viet Nam 30 Total Return Index | HSX | fixed |
VNALL_TRI | total_return_index | Viet Nam All Share Total Return Index | HSX | flexible |
VNDIAMON_TRI | total_return_index | Viet Nam Diamond Total Return Index | HSX | flexible |
VNFINLEA_TRI | total_return_index | Viet Nam Leading Financial Total Return Index | HSX | flexible |
VNFINSEL_TRI | total_return_index | Viet Nam Financial Select Sector Total Return Index | HSX | flexible |
VNMID_TRI | total_return_index | Viet Nam Mid Cap Total Return Index | HSX | fixed |
VNSML_TRI | total_return_index | Viet Nam Small Cap Total Return Index | HSX | flexible |
HNX | price_index | HNX Index | HNX | flexible |
HNX30 | price_index | HNX30 Index | HNX | fixed |
HNXCON | price_index | HNX Construction Index | HNX | flexible |
HNXFIN | price_index | HNX Financials Index | HNX | flexible |
HNXLCAP | price_index | HNX Large Cap Index | HNX | fixed |
HNXMAN | price_index | HNX Manufacturing Index | HNX | flexible |
HNXMSCAP | price_index | HNX Mid/Small Cap Index | HNX | flexible |
UPCOM | price_index | UPCOM Index | HNX | flexible |
UPCOMLARGE | price_index | UpCom Large Index | HNX | flexible |
UPCOMMEDIUM | price_index | Upcom Medium Index | HNX | flexible |
UPCOMSMALL | price_index | Upcom Small Index | HNX | flexible |
HNX30_TRI | total_return_index | HNX30 Total Return Index | HNX | fixed |
VNXALL | price_index | Viet Nam Cross All Share Index | HSX | flexible |
VNX50 | price_index | VNX50 Index | HSX | fixed |
Note
Reference of the listed index by exchange:
-
For HSX:
Example:
- For HNX, following the reference URL: Introduction about Index
Example:
Endpoint at Pluto Production: https://prod-inno-pluto-2yrayayjeq-as.a.run.app
Endpoint | Description |
---|---|
/index/profile/ | Get profiles metadata of index |
To fetching all index codes profiles.
curl -X 'GET' \
'https://prod-inno-pluto-2yrayayjeq-as.a.run.app/index/profile/?offset=0&limit=10' \
-H 'accept: application/json'
Note
Note the limit currently are 10. You can increase the limit for full-context
To search available index. E.g: Search VN30
curl -X 'GET' \
'https://prod-inno-pluto-2yrayayjeq-as.a.run.app/index/profile/?code=VN30&offset=0&limit=10' \
-H 'accept: application/json'
Index Consituent¶
Description:
The constituent is a baskets of tickers for index in a specific period. Dimensions for this dataset is index code, period and ticker.
The basket updated by the investment council and public published by Exchange.
Let take an example for HOSE, they published the init basket for period 2023-01 by following document
Note
HOSE published at Vietnamese only
HNX published latest record only
Source:
Came from Exchange (HNX, HSX). Published frequency described by the ground-rules for each index.
Schema:
Column | Type | Description | Required | Primary Key | Note |
---|---|---|---|---|---|
code | Text | The Index Code, ref to Index Profile | Yes | True | |
period | Text | Period of constituent, in month type | Yes | True | E.g: 2023-01 |
ticker | Text | Ticker code in basket | Yes | True | |
inclusion_outstanding_share | BigInteger | The outstanding share inclusion to calculate index | - | ||
free_float_factor | Float | Free-float factor for index, has been rounded | - | ||
liquidity_ratio | Float | Liquidity Ratio | - | ||
cap_rate_limit | Float | Weighted market cap ratio | - | ||
change_status | Text | The status of change for ticket | - | ||
reason | Text | Reason why the change happend | - | ||
reason_url | Text | Reference URL to the reason | - | ||
effective_date | Date | The effective of the basket will take place | - | ||
comment | Text | Internal comment related to record | - | ||
created_by | Text | User has been created record | - | ||
updated_by | Text | User has been updated record | - | ||
verified_by | Text | User has been verified record | - | ||
created_at | Datetime | Datetime of created take place | - | ||
updated_at | Datetime | Datetime of updated take place | - |
Note
For the Total Return Index, the underlying constituent is the constituent of the same related index.
E.g: VN30_TRI
Index basket will be the basket of VN30
Endpoint at Pluto Production: https://prod-inno-pluto-2yrayayjeq-as.a.run.app
Endpoint | Description |
---|---|
/index/profile/ | Get profiles metadata of index |
Market Capitalization¶
Description:
The methodology to calculate the market capitalization for index:
with:
-
i = 1,2,3,n ...
-
n: number of tickers in index basket
-
\(p_i\): Price of ticker i in basket at the point of calculation.
-
\(s_i\): Number of outstanding share of ticker i in basket at the point of calculation.
-
\(f_i\): Free-float (rounded) of ticker i in basket at the point of calculation.
-
\(c_i\): the capping limit ratio of ticker i in basket at the point of calculation.
Required dataset:
Based on the methodology, the list below is required dataset to calculate this data.
-
The Capture the constituents of each index
-
Latest Trading OHLCV for tickers in constituents
-
Get weight of each ticker in the baskets
-
Captuterd Capture the outstanding share for each ticker
Warning
The market capitalization calculate by above method is not the-reported-figure
in the website
In the website, the market capitalization is just
They are missing multiple \(f_i\) and \(s_i\)
The errors, come up with our methodology is go align with the CMV of reported figure.
The reported figured is published at official Exchange website
-
HSX at: https://www.hsx.vn/Modules/Listed/Web/HoseIndexView/?fid=726e15cba4b04cb09ae4aa0b04bffee0
-
HNX at: https://hnx.vn/co-phieu-etfs/chi-so-tong-hop-thong-tin-co-ban.html > Choose index [HNX Index]
or at: https://hnx.vn/co-phieu-etfs/danh-muc-chi-so.html
Info
Remind that the price is laest or last (n-1) trading day
Warning
Others providers like [Vietstock, SSI] not have the information of index market capitalization.
Index OHLCV¶
Latest¶
[Wait] This feature waiting for testing.
Historical [Experiment]¶
[Wait] This feature waiting for testing.
Operation¶
Operation for this feature related to 3 underlying datasets:
Table: Operation Channel Datasets
Dataset | Description | Available |
---|---|---|
Ticker OHLCV | The OHLCV of ticker related in basket | |
Index Profile | Profile metadata of index | |
Index Constituent | Basket of index at the specific period |
The Operation URL currently are: Operation Channel
This route will be changes when we matching to the data.innotech.vn
domain. We will notice you this.
Troubleshooting¶
[1] Missing the underlying index¶
Go to Operation, add new record.
[2] Wrong underlying index code¶
The Index code is not unique, because this is not authorzied. This is different between provides
At Innotech, we created the parsors for alias to handling this.
For this, updated the parsors by add/delete related to the new index.
[3] The underlying basket not updated¶
Go to Operation, add new record or upload by file