Corresponding author: Elena Fyodorova ( ecolena@mail.ru ) © 2019 Non-profit partnership “Voprosy Ekonomiki”.
This is an open access article distributed under the terms of the Creative Commons Attribution License (CC BY-NC-ND 4.0), which permits to copy and distribute the article for non-commercial purposes, provided that the article is not altered or modified and the original author and source are credited.
Citation:
Fyodorova E, Sayakhov R, Demin I, Afanasyev D (2019) The influence of conference calls’ semantic characteristics on the company market performance: Text analysis. Russian Journal of Economics 5(3): 297-320. https://doi.org/10.32609/j.ruje.5.47422
|
The purpose of the study is to find out the influence of semantic (emotional coloring, length and complexity of the text) and thematic features (environmental, corporate-social and legal context) of conference calls with market analysts and investors on future company performance (CAR) and analysts’ recommendation for the share. The empirical framework of the research includes annual conference calls of public companies on the Moscow (MOEX) and London Stock Exchanges (LSE) from 2015 to 2019. The research methodology is based on the semantic analysis of the call text by using the linguistic dictionaries NRC 2010 and Corporate Social Responsibility 2016. The results of the study illustrate the significant impact of textual features of the conference call (the general tone of the call, the tone of management and the negative tone of analysts, the length and complexity of the text) on the abnormal stock returns (for 3, 14, 30 days). This relation is consistent for companies of both stock exchanges, but diverges in terms of the influence of the thematic characteristics of the call that can be explained by the mandatory disclosure of this information by European public companies (ESG Reports), as opposed to voluntary publication by Russian companies. The results can be applied both by the management of public companies in order to improve companies’ attractiveness (perception and transparency) and its market value in the short and medium-term period, and by investors to manage effectively the portfolio by predicting the future dynamics of the company’s share price after a conference call based on semantic tone and thematic features.
conference call, semantic analysis, thematic analysis, non-financial information, neural network MLP, linguistic glossaries
The key factors in forging a company’s attractiveness, image and market value are two instruments: the firm’s financial results that are published on a periodic base and its strategic outlook and guidance in the long term. On the one hand, analysts and institutional investors determine the fair value of the company, which is reflected in the market share price or in their investment decisions, as well as in the recommendations regarding its attractiveness (“buy”, “neutral”, “sell”), based on the periodic operating and financial performance of the company. On the other hand, the published financial results and company press releases can be a trigger to eliminate the information asymmetry between company management and external market participants (investors, analysts, the state) that makes financial markets most effective in terms of the economic theory (agent theory). One of the key and reputable tools for mitigating the information asymmetry between the company and the financial market is officially published information (business efficiency and growth outlook, dividend and social policy, compliance with environmental standards and emission reductions, ensuring staff motivation) in the public domain by management through new information channels: press releases of operating and financial results, CEO and Board of Directors (BoD) Letters, investor conference calls, etc. The given information allows for the efficient optimization of expectations of all market agents regarding the firm opportunities and perspectives that will affect inevitably the market share price and performance since this information is fundamental and public for all financial markets and investors.
The purpose of the research is to find out and estimate the influence of semantic and thematic features of annual conference calls (company management with analysts and investors) on a company’s future market performance. The relevance of this survey is validated, on the one hand, by the lack of scientific articles in this field among public firms from developing countries and Europe and the absence of research on the impact of conference calls’ linguistics and topics on a company’s future performance. On the other hand, the significance of this paper is justified by the increasing popularity of new communication channels between company management and investors and market bank analysts (CEO and BoD Letters, conference calls, investor day releases).
The subject that is related to the influence of non-financial information becomes more popular and relevant not only for foreign researchers but also for Russian economists. In recent work in this field,
The basis of the research (data sample) conducted is conference calls (selector meetings by telephone). Conference calls are periodic teleconferences (quarterly/semi-annual/annual) led by management of public companies with investment banking analysts as well as private and institutional investors and held in order to discuss operational and financial results. They also explain briefly the company’s strategy next quarter/year and enable a short airing of questions about the company that interest analysts and investors. The conference call is provided by the management of the company on a voluntary basis, but: (1) an increasing number of public companies from emerging markets (including EMEA) introduce this principle of communication with investors in order to increase transparency and trust for the firm, to strengthen the attractiveness and competitiveness of the company among industry peers. This fact is reflected in the dynamics of the number of conference calls that were held both for a certain company and for companies in the market as a whole (the growth in the number of companies conducting conference calls); (2) the call is regulated by the company in advance (published on the company’s website calendar and brought to analysts and brokers beforehand) and allows any interested investors to take part in the call without restriction; (3) the results of the call (transcripts) together with the question-answer part (Q&A) are available in the Bloomberg / Thomson Reuters financial monitors in the public domain within 2–3 days after it has taken place.
Organized teleconferences of the company’s management with market analysts have become a pivotal avenue of public information disclosure by the share issuer concerned in recent years. The main objective of this communication channel with the financial market is to clarify the meaning of the operational and financial results that the company periodically discloses on a quarterly basis. In many cases, financial results provided by a company fail to indicate any correct and definite conclusions about the effectiveness of the firm’s performance in the past period or its future growth prospects. This is only achieved through market analysts who act as mediators between the company management and investors by explaining information and addressing particularly pertinent questions.
It should be noted that each type of placed information (annual report, press release, operating results, RAS / IFRS statements) is traditionally published at different times. This eliminates the short-term effect of the publication of one reporting on another in terms of share price. However, a conference call involves wider topics and themes (without strict restrictions and a framework in the Q&A section), and allows for efficient communication between management and investors on the topics of financial and operational results, ecology, investment and the dividend policy, etc.
This article aims to illuminate whether there is an emotional and thematic differentiation in the conference call of public companies between its management and research analysts from different countries and stock exchanges, and whether these factors really affect the dynamics of the share price in the future or analysts’ recommendations for certain equity.
Nowadays the management of public companies will use various strategies to manage a company’s image and attempt to shape positive impressions. These strategies conceptually based on existing scientific literature can be classified in the following ways: semantic distortion of information (difficulty in text reading), rhetorical manipulation (using coherent and logical text), thematic distortion (using special vocabulary — maximum positive and minimum negative words, the bias of the tone and topic), visual distortion (visualized data and information presented), comparison of results with worse benchmarks (shift of analog companies to companies with worse performance — the bias), the choice of a limited number of financial and operational indicators in favor of the company side (disclosed to investors).
The motives and strategies of the company management for manipulating and distorting voluntarily disclosed information and reporting can be presented schematically in Fig.
Ways of managing of company impression and image.
Source: Compiled by the authors using the data from
Most of the strategies can be actively applied by the company management and do not necessitate presenting distorted information to external participants, including investors. Some of them, however, are applicable to the disclosure and publication of textual information and the reporting (text perception, structural distortion, manipulation of subjects), while other strategies are used to present data in conference calls and company presentations (visual distortion, emotional and rhetorical manipulation). The feature of the presented strategies of media manipulation is the opportunity of its simultaneous application, which allows for multiplying the positive impression and growth opportunity of the company in the eyes of external participants (investors). Meanwhile, researchers (
Nevertheless, rhetorical manipulation by means of sound perception of the tone and its color and the visual distortion of information through the creation of special presentation and reports structure have become very popular and important in financial markets these days. These instruments form new and modern communication channels between the company management and market participants. They allow drawing the viewer’s focus exclusively on the positive characteristics and certain financials that the company wants to disclose and convey to investors and shareholders. As part of our theoretical and empirical analysis, we advance six hypotheses, presented below, that will be tested in the research.
Hypothesis 1. The presence of a significant positive relationship between the conference call tone and the future excess share return of the company (CAR) in the short and medium terms.
This hypothesis assumes that the more positive the text tone, the more favorable the impression and mood created for readers (analysts and investors). Then they will subsequently revise upwards their expectations and recommendations concerning this company. In the framework of the study, the NetSent and PosSent variables will be used as the “semantic” (tonality) variables, and the formula description of them will be given below. Previously, this hypothesis was confirmed in earlier studies, which were devoted to the text tone of CEO and Board of Directors Letters as well as press releases according to the sample of USA companies of S&P500, German and Russian public firms (
Hypothesis 2. The presence of a significant negative relation between the negative tone of analysts and investors in the Q&A part of the conference call and the change in the recommendation for this equity by investment analysts in the future (“buy”, “neutral”, “sell”).
Since investment banking analysts and institutional investors are the information intermediaries between the company and the financial markets, it is assumed that the call tone used by participants reflects their impression and interest in certain equities and that this is replicated to change or maintain the recommendations in Equity Research after making the call: strictly sell (5), sell (4), hold (3), buy (2), strictly buy (1). Due to the weak efficiency of the financial market, the given information should be reflected in recommendations 30 days after the date of conference call as a minimum. Previously, hypothesis 2 was not tested in samples of conference calls, but in
Hypothesis 3. The future market performance of the company is more sensitive to the conference call tone of analysts and investors than to the tone of company management.
Indeed, the conference call tone and the general position of the company’s management is biased in favor of creating a positive impression and a high image of the firm, while the position of analysts and investors, on the one hand, reflects the mean market sentiment, fair valuation and all relevant information about the company. On the other hand, analysts’ valuations are the most objective since they are not attached to the position of the company. In other words, the represented hypothesis suggests that the tone of bank analysts is a better predictor of the future market and financial performance of the company than the tone and emotional coloring of the management text and speech.
This fact can be explained by the possibility of direct influence of analysts on the market and investors, in particular by changing the recommendation regarding certain equity, or by issuing public news with a negative or positive connotation after the completed conference call. The similar hypothesis was previously tested in
Hypothesis 4. The existence of the significant negative link between the length, complexity of the text of the call with analysts (number of words, FOG index) and the future market performance of the company.
This hypothesis assumes that the conference call text should be concise, clear and simple. Further, that the company’s management is not motivated to embellish and distort factual information at its disposal and so obscure a correct understanding of the overall picture for listeners and investors. It assumes that they will enable correct interpretation of the given text. If, on the other hand, a presentation is over-complex or characterized by wishful thinking, then analysts and investors may perceive this information as distorted or interpret it as a possible attempt at manipulation on the part of the company’s management to “obscure” negative facts and news. This can undermine the dynamics of stocks in the short or medium term. Previously, this hypothesis was verified in
Hypothesis 5a. The degree of non-financial information disclosure during a call (ecology, social responsibility, protection of human rights, etc.) is significantly and positively related to the future excess return of the company share.
Hypothesis 5b. The degree of non-financial information disclosure during a call (ecology, social responsibility, protection of human rights, etc.) is significantly and negatively related to the forecast error regarding earnings per share (EPS surprise).
These hypotheses imply the significance and essentiality of non-financial information that is disclosed by companies on a voluntary basis and allows investors and analysts to take into account all risks and nuances as far as possible when they valuate the attractiveness of equities and build financial projections for the company’s future. The given information should lead ultimately to an increase in the accuracy of the forecast (reduction in error) and the absence of surprise (the forecast error of analysts) in dividends and earnings per share. In earlier studies, these hypotheses were not tested in conjunction with the considered dependent variables (the forecast error and dividend surprise), since the applied dictionaries in this paper appeared relatively recently (2016–2018) and have not yet been tested in studies in this field, but the dependent variables are presented only in a limited sample of companies and usually only for the period up to 2012–2013.
Hypothesis 6. The conference call tone of bank analysts, company management and thematic features of the conference call significantly differ between the companies of the Moscow and London Stock Exchanges.
The research conducted suggests that the semantic and linguistic features of the call conducted by the company’s management can be perceived differently by analysts and investors of the European and Russian financial markets because: (1) there may be differences in the information efficiency of these markets; (2) the track record of these calls for companies of LSE is several times longer than for companies of the Moscow Stock Exchange. This can be reflected in a more conservative or emotional tone of European call participants in comparison to colleagues from the Russian financial market. Earlier, the similar hypothesis in the framework of conference calls has not been tested, but significant difference in tonality geographically was found in the sample of CEO Letters in the recent works (
The advanced hypotheses in this section will be tested using the econometric tools and machine learning (neural network; see the next section).
The main methodological and technical complication of the study is the analysis of textual information, namely the transcripts of management calls with analysts, since it is required to derive a vector of quantitative variables from qualitative data (text parameters), which describe it from the position of emotional coloring, tonality, complexity and subject. Previously, the surveys in this field and in general in the analysis of textual information and relation with financial variables were practically absent, since there was no suitable data tools for computer analysis and transformation of the data from a qualitative type to a quantitative one. However, modern methods of analysis of information have appeared with the development of computer technologies and new programming languages in recent years, and among them one of the most popular has become the method of “bag of words” (
In the last decade, a significant number of such economic, financial, and news dictionaries have appeared based on the surveys of a large volume of press releases of companies’ financial results, CEO Letters and BoD Letters, financial reports (10-K, 10-Q) of US and European companies. Applying these data, the researchers have built dictionaries of financial and economic topics with the assignment to words of certain emotional orientation and tonality. Principally, the original and modern dictionary will be used in the framework of this work, — NRC (National Research Council) — the advantage of that is, firstly, a higher number of words in the glossary (6468 terms instead 3916 terms in the vocabulary of
Table
Description of linguistic variables.
To test the hypotheses 1–3, the regression models will be built based on panel data applying conference call transcripts where the semantic and linguistic characteristics are the explanatory variables, and future market and financial indicators of the company, as well as analysts’ recommendations regarding the attractiveness of the stock, are dependent variables.
Additionally, the control variables are included in regression models that are estimated below. It is necessary, firstly, to fix the effect of non-financial information on the company’s future market performance and its tonality level, and secondly, these factors have been successfully tested and applied in recent empirical studies in this field (
The financial (control) variables are used with a lag of 1 year in the presented models below (the control variables for the fiscal year 2018 are used for the call of 2019). Since the call is conducted on the basis of financial and operational results from the previous year, the model output considers the linguistic textual factors separately from the impact of financials. Control variables are used to separate the “financial impact” of information on future share return from the effects of “linguistic” and “thematic” influence.
The main control variables used are ROE, ROA, Size (logarithm of revenue / assets), Asset Turnover, Leverage, financial covenant Net Debt / EBITDA, logarithm of working capital change in this study (Change in WCi,t +1).
To test hypothesis 1, a regression model (1) was constructed which is presented below:
CAR (0, T) i,t = β0 + β1 × ROEi,t –1 + β2 × Sizei,t –1 + β3 × ATi,t –1 +
+ β4 × EBITDAMargini,t –1 +β5 × NetSenti,t –1 +
+ β6 × Change in WCi,t –1 + εi,t , (1)
where:
CAR (0, T) i,t = ARτ — cumulative abnormal return since T days after conf. call of company i for year t;
ARτ — abnormal return in day τ of company i for year t;
Pi,τ — share price of company i in day τ;
Pm,τ — market index m in day τ.
In this study, the market value (return) of the stock exchange index is measured as the component of excess returns (AR) instead of the classically applied expected return ERi,τ in financial theory. Firstly, this is explained by using Pm,τ instead of ERi,τ in most modern works in the field of finance, and, secondly, the application of ERi,τ is possible only together with the assumption of the perfect financial market and with a number of the assumptions of CAPM model, which can be broken in real financial markets. The Moscow Stock Exchange Index was used as a market index for the Moscow Stock Exchange companies and the FTSE100 index for companies from the London Stock Exchange.
Various modifications of the parameter will be used depending on the number of days (T) after the conference call (3 days / 14 days / 30 days) since hypothesis 1 is tested on the short and medium term.
To test hypothesis 2, model (1) will be modified as follows:
∆Recomm (0, T) i,t = β0 + β1 × ROEi,t –1 + β2 × Sizei,t –1 + β3 × ATi,t –1 +
+ β4 × EBITDAMargini,t –1 + β5 × NegSent_Q&Ai,t –1 +
+ β6 × Change in WCi,t –1 + εi,t –1 , (2)
where ∆Recomm (0, T) i,t = Recomm (T) i,t – Recomm (0) i,t –1 — change in mean analysts recomendation for period [0; T] .
In model (2), the following classification is considered as a recommendation for a specific stock that is proposed by Thomson Reuters and Bloomberg: 1 — strictly buy, 2 — buy, 3 — neutral (hold), 4 — sell, 5 — strictly sell. Thus, if the variable ∆Recomm (0, T) i,t +1 is negative, the recommendation for the (equity) share improves in a favorable way for the purchase. In the model, this variable will be applied in two versions: a short-term change (1 month) and long-term change in the recommendation (till the end of the year since the conference call ending).
To test hypothesis 3, we also modify model (1) in part of the parameter PosSenti,t (reflects the tone of the complete text), instead of which we apply separately PosSentManagementi,t and PosSentAnalysti,t. The hypothesis will be verified by comparing the estimates of the coefficients βi for these variables by module.
To test hypothesis 4, the regression model (3) is constructed based on panel data and presented below, which is the modification of the model (1), where the variable PosSenti,t is excluded (because it directly correlates with the variable Wordsi,t) :
CAR (0, 3)i,t = β0 + β1 × ROEi,t –1 + β2 × Sizei,t –1 + β3 × ATi,t –1 +
+ β4 × EBITDAMargini,t –1 + β5 × Wordsi,t –1 +
+ β6 × FOGi,t –1 + β7 × Change in WCi,t –1 + εi,t , (3)
where: Wordsi,t — number of total words in a conference call;
FOGi,t — coefficient of the complexity of text understanding (+
× 100).
Table
FOG Index distribution (level of text complexity).
FOG Index | Text characteristic |
≥ 18 | Impossible to read |
14–17.99 | Difficult to read |
12–13.99 | Text is completely clear |
10–11.99 | Acceptable for reading |
8–9.99 | Simple text |
The particular method of research in the context of text analysis is the estimation of the significance of non-financial information and its impact on the company’s future performance and the accuracy of analysts’ forecasts regarding key performance indicators (earnings per share, dividend surprise). Linguists and economists have done massive research to create and compile thematic dictionaries in 2010–2018 based on various materials and scientific sources that allow to cluster words and spoken phrases in specific topics. Among the modern and most authoritative dictionaries in the scientific community, it seems possible to highlight the Corporate Social Responsibility Words dictionary (
To test hypotheses 5a and 5b on the basis of the analyzed literature, the variables responsible for the thematic focus of the call transcript will be included to the modification of model (1):
CAR (0, 3)i,t = β0 + β1 × ROEi,t –1 + β2 × Sizei,t –1 + β3 × ATi,t –1 +
+ β4 × EBITDAMargini,t –1 + β5 × Sociali,t –1 +
+ β6 × Enviri,t –1 + β7 × Humanri,t –1 + εi,t , (4)
EPS_Surpi,t = ROEi,t –1 + Sizei,t –1 + ATi,t –1 +
+ EBITDAMargini,t –1 + Sociali,t –1 +
+ Enviri,t –1 + β7 × Humanri,t –1 + εi,t , (5)
where: Sociali,t — share of words about corporate social thematic in call; Enviri,t — share of words about environmental thematic; Humanri,t — share of words about human and worker rights; EPS_Surpi,t1 = EPS_facti,t – EPSforecasti,t –1 — analyst forecast error of earnings per share (“earnings per share surprise”).
Previously, these hypotheses were not tested by researchers, since there were no specialized thematic dictionaries and tools for testing them.
To verify hypothesis 6, the model (1) itself was tested separately for a selection of conference calls for management of companies in Moscow and London Stock Exchanges in order to find significant difference in estimates of coefficients for linguistic variables.
To test the advanced hypotheses and in accordance with the research branch, further companies were selected from different financial markets based on the following selection criteria: companies are public and have been trading on the Moscow and London Stock Exchanges continuously since 2014 and are in the top 100 of the market capitalization and the top 100 of daily trading volume among firms on the exchanges; availability of annual conference calls’ transcripts with investors and analysts without omissions in English in 2015–2019; the minimum number of words in the text of the call exceeds 200 words; the absence of gaps in historical financial results and variables in the Thomson Reuters and Bloomberg databases that are used in the research.
The initial sample of companies in the study consisted of 75 companies from the London Stock Exchange and 60 companies from the Moscow Stock Exchange, but, in the process of financial information and conference call transcripts’ consolidation, the observations (companies) were excluded where several transcripts were missing or there were significant omissions (> 5% observations of all data) by historical data. The final sample consists of 36 companies in MOEX and 35 companies of the LSE, where the equity of these companies have been traded continuously since 2015.
Tables
Descriptive analysis of financial variables (MOEX companies).
Variable | Min | Q1 | Median | Mean | Q3 | Max |
Market Cap | 8.65 | 9.51 | 9.82 | 9.84 | 10.14 | 10.91 |
Size (Log Assets) | 8.67 | 9.71 | 9.96 | 10.06 | 10.23 | 11.67 |
ROE, % | –87.0 | 10.0 | 18.0 | 23.0 | 28.0 | 459.0 |
EBITDA_margin, % | 5.0 | 15.0 | 26.0 | 28.0 | 34.0 | 80.0 |
Net Debt/EBITDA | 0.0 | 0.73 | 1.39 | 3.09 | 2.14 | 91.33 |
Leverage | 0.0 | 0.36 | 1.10 | 3.10 | 2.41 | 52.91 |
Asset Turnover | 0.00 | 0.51 | 0.67 | 0.81 | 0.96 | 2.51 |
Change in WC | –10.34 | –8.72 | –8.46 | –5.21 | –7.74 | 10.21 |
EPS_Surprise, % | –25.0 | –1.0 | 0.0 | 1.0 | 3.0 | 27.0 |
Recommendation | –1.50 | –0.06 | 0.00 | –0.02 | 0.01 | 1.80 |
CAR (0, 3) | –0.15 | –0.06 | –0.02 | 0.01 | 0.06 | 0.34 |
CAR (0, 14) | –0.36 | –0.10 | –0.01 | 0.02 | 0.07 | 0.94 |
CAR (0, 30) | –1.17 | –0.04 | 0.01 | 0.04 | 0.09 | 1.51 |
Descriptive analysis of financial variables (LSE companies).
Variable | Min | Q1 | Median | Mean | Q3 | Max |
Market Cap | 9.55 | 9.85 | 10.29 | 10.32 | 10.74 | 11.24 |
Size (Log Assets) | 9.13 | 9.85 | 10.45 | 10.48 | 10.96 | 12.42 |
ROE, % | –5.0 | 9.0 | 14.0 | 16.0 | 22.0 | 57.0 |
EBITDA_margin, % | –0.06 | 0.14 | 0.28 | 0.34 | 0.42 | 1.80 |
Net Debt/EBITDA | 0.00 | 0.62 | 1.23 | 2.25 | 2.25 | 38.13 |
Leverage | 0.08 | 0.45 | 0.68 | 1.21 | 1.55 | 10.98 |
Asset Turnover | 0.00 | 0.24 | 0.46 | 0.56 | 0.85 | 1.66 |
Change in WC | –10.83 | –9.07 | –8.25 | –4.22 | 6.93 | 10.74 |
EPS_Surprise, % | –170.0 | –1.0 | 0.0 | –1.0 | 1.0 | 48.0 |
Recommendation | –0.89 | –0.12 | 0.00 | 0.01 | 0.09 | 3.00 |
CAR (0, 3) | –0.15 | –0.02 | 0.01 | 0.01 | 0.04 | 0.27 |
CAR (0, 14) | –0.11 | –0.01 | 0.03 | 0.03 | 0.06 | 0.45 |
CAR (0, 30) | –0.16 | –0.04 | 0.01 | 0.02 | 0.07 | 0.69 |
On the other hand, attention should mostly be paid to descriptive statistics of linguistic variables of the conference calls (Tables
Descriptive analysis of linguistic and thematic variables (MOEX companies).
Variable | Min | Q1 | Median | Mean | Q3 | Max |
Words | 689 | 2460 | 3473 | 3549 | 4266 | 12 939 |
FOG Index | 10.56 | 12.26 | 12.94 | 13.02 | 13.57 | 17.79 |
PosSent | 0.09 | 0.11 | 0.12 | 0.12 | 0.13 | 0.17 |
NegSent | 0.02 | 0.03 | 0.03 | 0.03 | 0.04 | 0.08 |
NetSent | 0.03 | 0.07 | 0.08 | 0.09 | 0.09 | 0.15 |
Environment | 0.01 | 0.02 | 0.02 | 0.02 | 0.03 | 0.05 |
Social Disclosure | 0.01 | 0.02 | 0.02 | 0.02 | 0.02 | 0.04 |
Human Rights | 0.00 | 0.01 | 0.01 | 0.01 | 0.01 | 0.03 |
Words_Q&A | 68 | 1171 | 1814 | 1917 | 2376 | 6364 |
FOG Index_Q&A | 10.04 | 12.07 | 12.78 | 12.84 | 13.52 | 19.26 |
PosSent_Q&A | 0.06 | 0.11 | 0.12 | 0.12 | 0.13 | 0.18 |
NegSent_Q&A | 0.00 | 0.02 | 0.03 | 0.03 | 0.04 | 0.09 |
NetSent_Q&A | 0.02 | 0.07 | 0.09 | 0.09 | 0.10 | 0.15 |
Descriptive analysis of linguistic and thematic variables (LSE companies).
Variable | Min | Q1 | Median | Mean | Q3 | Max |
Words | 1556 | 4764 | 6009 | 6154 | 7466 | 13 317 |
FOG Index | 9.45 | 11.56 | 12.37 | 12.35 | 13.03 | 16.26 |
PosSent | 0.08 | 0.11 | 0.11 | 0.11 | 0.12 | 0.15 |
NegSent | 0.02 | 0.03 | 0.03 | 0.03 | 0.04 | 0.05 |
NetSent | 0.04 | 0.07 | 0.08 | 0.08 | 0.09 | 0.13 |
Environment | 0.01 | 0.02 | 0.02 | 0.03 | 0.03 | 0.05 |
Social Disclosure | 0.01 | 0.02 | 0.03 | 0.03 | 0.03 | 0.06 |
Human Rights | 0.01 | 0.01 | 0.02 | 0.02 | 0.02 | 0.04 |
Words_Q&A | 317 | 2297 | 3279 | 3219 | 4032 | 8302 |
FOG Index_Q&A | 9.38 | 11.02 | 11.75 | 11.77 | 12.32 | 21.14 |
PosSent_Q&A | 0.07 | 0.09 | 0.10 | 0.10 | 0.11 | 0.14 |
NegSent_Q&A | 0.01 | 0.02 | 0.03 | 0.03 | 0.03 | 0.05 |
NetSent_Q&A | 0.05 | 0.07 | 0.07 | 0.07 | 0.10 | 0.12 |
Thematic coverage of environmental aspects of the call with analysts (“Environment”) is practically the same, despite the fact that government regulation and the emphasis on green production is much stronger in Europe. In contrast, there is an advantage in disclosing the topics of social responsibility and protecting human rights among the companies of the London Exchange, which is supported by facts (the requirement of society and the EU for the mandatory disclosure and coverage of this information). At the same time, for both samples, the total word volume in the question-answer part (Q&A) of the call is almost 2 times lower than the conference call as a whole with more primitiveness and simplicity of proposals for companies of the London Stock Exchange. That may indicate an attempt to manipulate the topics by the management of Russian corporations when in the Q&A part (“difficult readability”). The emotional color (PosSent, NetSent) of the Q&A part of the call is brighter for Russian companies, which is manifested in the volume of positive and negative tone. It can be explained by their relative inexperience in conducting such events, both on the side of company management and market analysts in comparison to companies on the London Stock Exchange, that use a more restrained tone in the call.
Fig.
Most popular words for the general sample of conference calls by topics: social and environmental responsibility.
Source: Compiled by the authors.
Fig.
Dynamics of positive and negative words in conference calls for 2015–2019, MOEX and LSE companies.
Source: Authors’ calculations.
Fig.
Dynamics of thematic words in conference calls for 2015–2019, MOEX and LSE companies.
Source: Authors’ calculations.
The greater volume (number) of words in the topics of protecting human rights, social responsibility and the environment for LSE companies is explained, on the one hand, by the mandatory disclosure of this thematic in the EU region since 2012, and, on the other hand, by a large number of words in the framework of the conference call.
The complexity and the difficult readability of the text of the call has increased over the past five years for companies of both stock exchanges; however, the text of the Russian companies’ call is more comprehensive. Variable Net Sentiment (general call tone) also increased for companies in both samples, however, the calls of MOEX companies are more positive in 2019, despite almost the same tone level in 2015, which may indicate that Russian management is currently trying to semantically manipulate and distort the disclosed information.
The results of the study and the testing of hypotheses 1–3 (for the event window of 14 calendar days after the call) are depicted in Table
Results of testing Hypotheses 1–3 for MOEX and LSE companies.
Variable | MOEX | LSE | ||||
Hypothesis 1 | Hypothesis 2 | Hypothesis 3 | Hypothesis 1 | Hypothesis 2 | Hypothesis 3 | |
(Intercept) | 0.168 (0.09)* | –0.43 (–1.88)** | 0.19 (0.099)* | 0.14 (0.08)* | –0.03 (0.95) | –0.37 (0.22)* |
ROE | 0.009 (0.015) | 0.05 (–0.10) | – | 0.49 (0.19)** | 0.55 (0.023)* | – |
Size | 0.0159 (0.008)** | 0.0156 (0.008)* | 0.29 (0.009)** | 9.6e–03 (5.8e–03)* | ||
Posr | 1.36 (0.64)** | – | – | 2.25 (1.16)** | – | – |
Negr | – | – | – | – | – | – |
Netr | 0.88 (0.495)* | – | – | 2.04 (1.08)** | – | – |
Negr_Anlst | – | –0.01 (2.33) | – | – | 2.23 (0.77) | – |
Posr_Anlst | – | – | 0.25 (0.61) | – | – | 1.79 (0.94)** |
Netr_Anlst | – | 3.52 (–2.17)** | –0.32 (0.29)** | – | 0.31 (0.57) | –0.62 (1.63) |
Posr_Mngm | – | – | 0.53 (0.28)** | – | – | 0.38 (0.75) |
Envir | –2.40 (0.770)*** | – | –2.49 (0.74)*** | 1.32 (0.73)* | – | 1.38 (0.67)** |
Empl | – | – | – | – | – | – |
Humrights | – | – | – | – | – | – |
Words | 2.4e–06 (1.3e–06)*** | 9.15e–05 (–2.33)** | 2.2e–06 (1.17)** | 4.8e–06 (–0.13) | –3.7e–05 (0.08)** | –1.6e–05 (6.0e–06)*** |
Leverage | – | – | – | – | – | – |
ND/EBITDA | 4.9e–04 (6.5e–04) | –4.7e–03 (–1.34)* | 5.6e–04 (6.7e–04) | –2.6e–03 (1.9e–03) | 3.5e–03 (0.61) | –2.7e–03 (1.2e–03)** |
R 2, % | 16.13 | 17.78 | 13.45 | 14.77 | 15.21 | 11.68 |
F-test | 3.77 | 4.11 | 3.27 | 3.29 | 9.24 | 2.52 |
p-value | 0.033 | 0.026 | 0.049 | 0.0489 | 0.043 | 0.097 |
The study illustrates that the emotional coloring of the call (general tone), and the length and complexity of the text are significant factors that determine the future excess return of equities of companies from both stock exchanges (Moscow and London). This result is consistent with most studies of the past few years in developed capital markets. Hypothesis 1 about the significance of the general tone of the conference call text was confirmed in
However, the analyst’s tone in the call is not significantly connected with subsequent valuation (recommendation) of the company equity because of the probable presence of more significant variables (financial results) that affect analyst recommendations. In addition, the insignificant results of testing this hypothesis can be explained by the short-term horizon of the calculation of the variable “change in share recommendation” (up to 1 month), since many analysts might not yet update the recommendation taking into account the information received about the company in the call. It can be noticed that earlier this hypothesis was not tested by researchers, despite the availability of the data of average and median estimates of analysts’ recommendations in shares of public companies.
Moreover, the hypothesis of a stronger influence of the analyst’s tone than that of the management on future stock returns was confirmed only for companies of LSE. This result can be explained by the greater importance in the Russian stock market of the tone and topics of company management than market analysts, who are mainly only the link between corporations and the market. Besides, in previous works, the authors also received mixed results: this assumption was rejected in
Results of testing Hypotheses 4–5 for MOEX and LSE companies.
Variable | MOEX | LSE | |||||
Hypothesis 4 | Hypothesis 5a | Hypothesis 5b | Hypothesis 4 | Hypothesis 5a | Hypothesis 5b | ||
(Intercept) | 0.083 (0.043)** | 0.10 (0.028)*** | 0.05 (0.02)*** | 0.125 (0.075)* | 0.09 (0.046)** | –0.10 (0.098)* | |
ROE | – | 0.027 (0.015)** | – | – | 0.04 (0.03)** | – | |
ROA | 0.068 (0.51) | – | 0.126 (0.058)** | 0.061 (0.076) | – | 0.62 (0.33)** | |
Size | 0.015 (0.008)** | – | – | 0.017 (0.10)* | – | ||
FOG | –0.011(0.06)* | – | – | –0.013 (0.07)** | – | ||
Negr | – | – | – | – | – | ||
Netr | – | – | – | – | – | ||
Envir | – | –2.28 (0.65)*** | –1.12 (0.62)** | – | –3.27 (1.54)*** | –13.82 (7.79)** | |
Socialr | – | –0.36 (0.96) | –1.39 (0.79)** | – | 2.52 (1.42)** | –5.55 (6.90) | |
Humrights | – | 0.43 (1.73) | – | – | –0.58 (0.47) | – | |
Change in WC | 0.003 (0.011)** | – | – | – | – | ||
Leverage | 0.001 (0.002) | 0.001(0.0007) | –0.002 (0.0007)*** | 0.003 (0.002) | 0.06 (0.004)* | 0.03 (0.009)** | |
ND/EBITDA | –1.4e–04 (8.1e–05)** | – | –7.1e–04 (5.9e–04) | –0.002 (0.001)** | – | 0.04 (0.016)** | |
EBITDA_m | – | – | – | – | – | – | |
R 2, % | 11.79 | 9.45 | 20.89 | 10.31 | 13.57 | 8.72 | |
F-test | 3.28 | 3.01 | 6.52 | 2.85 | 4.55 | 2.77 | |
p-value | 0.049 | 0.081 | 0.017 | 0.091 | 0.0299 | 0.097 |
The complexity, readability and the length of the call text and top management Letters are the most popular hypotheses that are advanced and tested by the authors in this field. In this study, hypothesis 4 on the significance of the length and complexity of the text is not rejected, which confirms the results of recent studies (
Moreover, the disclosure of environmental topics is more likely associated with a discussion of its negative aspects and demonstrations — emissions, environmental accidents, and high investment costs to reduce pollution that ultimately negatively affects the market share price of equities after the call execution. Previously, these hypotheses were not tested by researchers, since there were no specialized thematic dictionaries and the tools for testing them.
The application of machine learning, namely the neural network of the MLP type (multilayer perceptron), as an alternative test of the advanced hypotheses, illustrates that the linguistic variables included in the model reduce the network error by 4–17% on the average and increase the correlation between the predicted and the actual value of the dependent variable by 5–13% (Appendix
The results of the regression analysis and the neural network estimation in the framework of hypothesis testing illustrate the fact that the semantic and thematic characteristics of annual conference calls of management with investors and analysts affect significantly the future market performance of the company and the forecast error earnings per share by analysts in the short and medium-term intervals (3 days/14 days/30 days). However, there is no significant relation between these indicators and analysts’ recommendations per share a month after the conference call. At the same time, it should be noted that the financial market affects the direction and importance of text information used by management, which ultimately affects the results of the influence of text characteristics and features of conference calls on the future market performance of public companies. In addition, a significant regional difference in the tone and manipulation of semantic and thematic characteristics of calls is revealed for companies from the Moscow and London Stock Exchanges.
The empirical significance of the research is in the opportunity of subsequent application of its results by the management of public companies for correct management and control of tone, topics and depth of information disclosure in the framework of the conference call. It is important in order to form and improve its attractiveness and the image for investors and market analysts, to increase the market value of the company due to the growth of stock quotes and improving the recommendations of analysts regarding its attractiveness in the short and long term.
The application of the results in this article is possible in two ways: firstly, by management of public companies from developed and emerging markets to reduce the negative perception of financial results and strategies discussed by analysts and investors, reducing the overall level of panic and behavioral irrationality in the short term; and secondly, by investors and analysts to more accurately predict the future financial, operational performance of the company, the strategy being implemented and identify excessive optimism or pessimism of management, which can be reflected in price dynamics both in the short and long term.
Results of application of MLP Neural Network Model.
Neural network error | Hypothesis 1 | Hypothesis 2 | Hypothesis 3 | Hypothesis 4 | Hypothesis 5a | Hypothesis 5b |
w/o linguistic variables | 0.492 | 10.42 | 0.47 | 0.54 | 0.67 | 0.208 |
with linguistic variables | 0.449 | 9.45 | 0.45 | 0.45 | 0.57 | 0.196 |
Decrease of MLP error, % | 9 | 9 | 4 | 17 | 15 | 6 |